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ABSTRACT 


\ 

The  cost  and  effectiveness  methodology  developed  in  Task  III  of  the 
INTACS  program  offers  a direct,  dependable,  and  flexible  means  for  evalu- 
ating the  capabilities  and  cost  of  the  candidate  mid  range  time  frame  Army 
communications  systems  concerned.  At  the  same  time,  it  constitutes  an 
effective  tool  for  ranking  these  systems  further  on  the  basis  of  techno- 
logical risk.  Thus,  the  methodology  developed  will  facilitate  the  selec- 
tion of  a preferred  system  as  intended. 


FOREWORD 


Thi->  report  has  been  prepared  by  the  /Martin  Marietta  Corporation  for 
the  Commandant,  USAS ESC,  in  accordance  with  the  provisions  of  Contract  No. 
!)AAt.39“73-C-0248.  It  documents  the  results  of  the  contractor's  activity 
in  response  to  the  requirements  contained  in  Task  III  and  is  intended  as 
an  input  to  the  on-going  work  of  the  INTACS  program.  The  comments,  con- 
t lusions,  and  recommendations  contained  herein  represent  the  professional 

dews  of  the  contractor  and  not  necessarily  those  of  the  Department  of  the 
Army . 
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1 . 0 INTRODUCTION 


This  report  documents  the  work  performed  during  Task  III,  Cost  and 
Effectiveness  Methodology  Development,  and  summarizes  the  results  of  that 
effort. 


1.1  TASK  III  OBJECTIVE 


The  objective  of  Task  III  was  to  develop  the  approaches  and  procedures 
to  be  employed  in  the  evaluation  and  rank-ordering  of  the  communications 
system  alternatives  to  be  developed  in  Task  V.  Specific  Task  III  efforts 
undertaken  to  satisfy  this  objective  were  as  follows: 

0 Development  of  a tactical  communications  system  effective- 
ness analysis  methodology; 

* Development  of  a cost  analysis  methodology; 

* Development  of  a risk  analysis  methodology; 

0 Development  of  a sensitivity  analysis  methodology; 

* Development  of  a cost/effectiveness  tradeoff  analysis 
methodology. 

While  the  objective  of  Task  III  was  to  develop  methodologies,  it  is  neces- 
sary, in  order  to  fully  understand,  appreciate,  and  evaluate  the  methodo- 

logles,  to  present  their  basic  elements  within  the  context  of  their  appli- 
cation. Therefore,  this  report  presents  brief  discussions  of  the  effec- 
tiveness, cost , risk,  and  cost/effectiveness  methodologies  within  the 
framework  of  their  application  in  Task  V,  Development  and  Analysis  of  Mid 
Range  Time  Frame  (MRTF)  Communications  Systems.  Particular  emphasis  is 
placed  on  the  role  these  methodologies  will  play  in  assisting  system 
designers  in  the  development  and  refinement  of  alternatives  and  in  pro- 
viding decision-makers  with  an  assessment  of  the  implications  associated 
with  pursuing  various  system  options.  Detailed  descriptions  of  the  metho- 
dologies developed  in  this  task  are  presented  in  appendices  to  this  report. 

Each  methodology  is  defined  in  terms  of  four  basic  elements:  1)  the 
output  to  be  produced;  2)  the  input  to  be  operated  on;  3)  the  analytical 
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procedures,  criteria,  techniques,  and  models  to  be  utilized;  and  A)  the 
sequence  of  procedures  to  be  followed  in  their  application. 

The  procedure  for  development  and  analysis  of  the  MRTF  communications 
systems  and  the  application  of  the  methodologies  within  this  procedure  is 
detailed  in  Section  2.0.  The  effectiveness  evaluation  criteria  (on  which 
system  effectiveness  evaluation,  design  refinement,  and  tradeoff  analysis 
will  be  based)  are  set  forth  in  Appendix  A.  rhe  cost  methodology  and 
referenced  cost  methodology  literature  are  presented  in  Appendices  B and 
C.  The  three  major  computer  models  that  will  be  used  in  Task  V are  briefly 
described  in  Appendix  D.  A sample  communications  system  evaluation,  using 
the  procedures  developed  in  Task  III,  is  presented  in  Appendix  E,  and  the 
sensitivity  analysis  of  the  procedure  is  presented  in  Appendix  F.  Appendix 
G highlights  the  methodology  for  the  evaluation  of  single  channel  systems. 
The  report  concludes  with  a table  of  abbreviations  (Appendix  ’!)  and  a glos- 
sary of  terms  (Appendix  I) . 


1.2  BACKGROUND 

The  overall  Integrated  Tactical  Communications  System  (1NTACS)  study 
program  is  intended  to  develop  detailed  and  comprehensive  communications 
support  and  implementation  plans  for  all  aspects  of  Army  tactical 
communications  support.  These  plans  must  describe  the  systems,  materiel, 
doctrine,  and  organizations  required  for  such  support  during  two  explicit 
periods  s 


° The  mid  range  time  frame  (MRTF),  from  1976  through  1986; 

° The  long  range  time  frame  (LRTF),  from  1987  onward. 

The  implementation  plans  must  include  a time-phased  sequence  of  event6, 
milestones,  and  decision  points  as  needed  with  regard  to  the  time  periods 
concerned. 

The  INTACS  program  is  divided  into  17  tasks,  with  the  first  seven 
Intended  to  address  the  MRTF  and  the  remainder  to  consider  the  LRTF.  In 
each  of  these  two  sets  of  tasks,  the  following  basic  activities  are 
prescribed; 

0 Refinement  of  alternative  MRTF/LRTF  communications  systems; 

0 Configuration  of  alternative  MRTF/LRTF  communications  systems; 

• Establishment  of  an  ordered,  weighted  set  of  criteria  for 
evaluating,  comparing,  and  ordering; 

0 Establishment  of  a cost  and  effectiveness  methodology  for 
evaluating,  costing,  comparing,  and  ordering  of  alternative 
MRTF/LRTF  communi cat ions  systems; 
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0 Determination  of  the  size  and  initial  coBt  of  the  baseline 
and  alternative  MRTF/I.RTF  communications  systems; 

0 Development  of  communications  support  requirements  for  alter- 
native concepts; 

0 Analysis  and  evaluation  of  candidate  MRTF/LRTF  communications 
systemr , and  identification  of  design  deficiencies  and  unsuit' 
abilities  of  alternatives  to  permit  subsequent  redesign  where 
permissible ; 

0 Determination  of  the  comparative  cost  of  alternative  systems; 

0 Tradeoff  analysis,  comparison,  and  rank-ordering  of  candidate 
systems . 

A graphic  depiction  of  the  logic  and  flow  of  the  foregoing  activities  is 
presented  in  Figure  2.0-1  (found  on  page  8). 


1.3  APPROACH 

If  the  INTACS  program  is  to  successfully  achieve  the  upgrading  of  the 
future  communications  posture  of  the  Army,  it  must  attain  a desired  level 
of  credibility  early  in  the  effort.  The  task  of  building  this  foundation 
of  credibility  commences  with  the  development  of  sound  methodologies. 

The  remainder  of  this  section  summarizes  the  fundamental  approach 
by  the  study  team  in  establishing  sound  methodologies  in  the  areas  of  effec- 
tiveness, cost,  risk,  sensitivity,  and  system  cost/effectiveness  tradeoff. 

1.3.1  Effectiveness  Analysis  Methodology 

System  effectiveness  refers  to  the  overall  capability  of  a system 
to  accomplish  its  intended  mission.  The  mission  of  an  Army  tactical 
communications  system  is  to  provide  deployed  units  with  the  communications 
support  needed  to  accomplish  their  objectives.  Thus,  the  ultimate  measure 
of  the  effectiveness  of  any  tactical  communications  system  is  the  degree 
to  which  that  system  enhances  the  probability  of  mission  accomplishment 
by  the  tactical  units  supported. 

Of  course,  the  calculation  of  this  probability  in  a totally  credible 
manner  is  an  impossible  task.  Primary  deterrents  are  the  difficulties 
associated  with  identifying  the  factors  upon  which  mission  accomplishment 
depends,  the  manner  in  which  these  factors  are  related,  and  the  absence 
of  operational  data  upon  which  the  analyst  can  draw  to  determine  the  way 
communications  affects  these  factors. 


In  approaching  Task  III,  therefore,  the  study  team  decided  to  base 
the  evaluation  of  INTACS  alternatives  not  on  the  success  likely  to  be  en- 
joyed by  the  units  supported,  but  upon  the  degree  to  which  each  alternative 
possessed  the  characteristics  deemed  inherently  desirable  in  a tactical 
communications  system.  The  Department  of  the  Army's  INTACS  Study  Advisory 
Group  (SAG)  and  the  Contracting  Officer's  Representative  (COR)  concurred. 

1.3.2  Cost  Analysis  Methodology 

Two  types  of  cost  information  are  required  to  meet  the  needs  of  the 
INTACS  program: 

0 Total  life-cycle  cost  (LCC)  estimates  for  each  alternative 
to  be  designed  and  analyzed  in  Task  V; 

0 A summary,  by  year,  of  costs  required  to  implement  each 
alternative  (necessary  to  develop  support  and  implementa- 
tion plans  for  the  preferred  concept  in  Tasks  VI  and  VII). 

The  cost  methodology  must  produce  the  required  cost  information  to 
support  the  subsequent  analysis.  One  cost  approach  will  estimate  the  total 
LCC  of  alternatives  to  aid  in  selecting  a preferred  concept,  while  the 
other  will  aid  in  programming,  budgeting,  and  controlling  the  preferred 
alternative  support  system  concept.  The  cost  methodology  will  be  applicable 
in  Tasks  V,  VI,  and  VII,  as  indicated  in  the  paragraphs  that  follow. 

Task  V is  to  develop  a candidate  communications  support  system  for 
each  alternative  concept  and  perform  cost,  effectiveness,  and  sensitivity 
analyses  to  recommend  a preferred  system.  The  LCC  methodology  will  be  used 
in  estimating  costs  of  the  alternative  system  concepts  to  be  used  in  trade- 
off analysis. 

Task  VI  will  produce  a detailed  communications  support  plan  based 
on  the  Government's  selection  of  a preferred  system.  In  this  plan,  man- 
power and  training  costs  for  the  specified  organizations  are  required,  along 
with  adjusted  procurement  and  inventory  costs  based  on  identified  equipment 
needs  and  inventory  shortfalls  to  aid  in  refining  the  materiel  program.  A 
subset  of  the  described  LCC  methodology  will  be  used  to  determine  these 
costs . 

In  Task  VII,  yearly  costs  are  required  for  programming,  budgeting, 
and  control  purposes.  The  methodology  of  time-allocation  of  costs  will  he 
used  to  produce  these  cost  estimates. 

In  developing  this  methodology,  it  was  assumed  that,  for  the  period 
of  interest  (1976  to  1986),  all  equipment  to  be  fielded  is  either  on  the 
shelf  or  currently  in  the  research  and  development  (R&D)  process,  ns  a 
result,  either  R&D  costs  are  sunk,  or  estimates  of  such  costs  have  already 
been  developed  and  an*  available.  A second  constraint  on  the  development 
of  the  methodology  was  the  type  and  availability  of  existing  cost  data. 
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Elements  of  total  LCC  and  time-allocation  of  cost  categories  for 
which  estimates  are  to  be  developed  were  identified  on  the  basis  of  a 
review  of  appropriate  Department  of  Defense  and  Department  of  the  Army 
regulations  and  other  available  data  to  determine  those  for  which  estimates 
could  be  developed.  Existing  models  and  data  were  reviewed  to  determine 
the  extent  to  which  they  would  be  applicable  to  the  needs  of  the  INTACS 
program.  On  the  basis  of  this  review,  the  procedures  were  then  identified 
and  developed  for  calculating  the  required  LCC  and  time-allocation  of  costs. 

Three  cost  constraints  will  be  applied  in  the  mid  range  time  frame 
evaluation  and  implementation: 

0 Total  hardware  cost  constraint 
0 System  life-cycle  cost  constraint 
0 Annual  cost  constraint. 


1.3.3  Risk  Analysis  Methodology 

The  risk  analysis  methodology  is  a procedure  for  assessing  the  po- 
tential technological  hazards  associated  with  the  MRTF  alternative  commu- 
nications systems.  A risk  analysis  is  required  because  the  implementation 
of  an  alternative  might  require  the  development  of  equipments  not  currently 
available.  In  carrying  out  such  developments,  the  possibility  exists  that 
equipment  with  the  required  characteristics  cannot  be  developed  within  the 
time  period  of  interest.  The  risk  analysis  flags  this  potential  difficulty 
so  that  it  will  not  be  overlooked  in  choosing  a preferred  alternative. 


1.3.4  Sensitivity  Analysis  Methodology 

Since  most  of  the  input  parameters  for  Task  V deal  with  the  future 
and  do  not  possess  the  desired  degree  of  accuracy,  a sensitivity  analysis  will 
be  performed  as  a means  of  considering  the  uncertainty.  A set  of  inputs  may 
be  little-known,  so  that  estimates  may  be  subject  to  error.  In  addition,  the 
subjective  utility  allocation  may  contribute  to  a lack  of  precision.  To  in- 
clude both  sources  of  error,  the  sensitivity  analysis  is  conducted  in  two  parts: 

° Parameter  sensitivity  analysis 
° Utility  allocation  sensitivity  analysis. 

The  parameter  sensitivity  analysis  consists  of  changing  an  assump- 
tion or  input  parameter  by  a specified  amount  and  determining  the  effect 
of  the  change  on  the  figure  of  merit  (FOM).  The  second  part  is  to  deter- 
mine the  effect  of  a slightly  different  utility  allocation  on  the  POM  for 
each  system. 
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1.3.5  Cost/Ef fectiveness  Tradeoff  Analysis  Methodology 

The  cost/ef fectiveness  tradeoff  analysis  will  be  the  last  phase  of 
the  cost/ef fectiveness  analysis  effort  prior  to  final  selection  of  a pre- 
ferred alternative.  The  first  step  will  be  to  construct  a summary  table 
to  aid  in  identifying  significant  differences  among  the  alternatives.  Next, 
those  alternatives  clearly  dominated  by  others  in  cost,  effectiveness,  and 
risk  will  be  identified;  alternatives  that  exceed  established  cost 
thresholds  will  also  be  identified.  After  the  identification  of  high-risk 
alternatives,  an  effectiveness/cost/risk  sensitivity  analysis  will  be  per- 
formed. Finally,  consideration  will  be  given  to  attributes  contained  in 
the  summary  table. 
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METHODOLOGY  FOR  DEVElflPMENT  AND  ANALYSIS 
OfThE  mrtF  COMMUNICATIONS  SYSTEMS 


The  Task  V methodology  (Task  V Task  Execution  Plan)  developed  in  Task 
III  i8  described  in  this  section.  Figure  2.0-1  shows  the  principal  ele- 
ments of  this  methodology,  the  interrelationships  between  elements,  and 
the  chronological  order  in  which  these  elements  will  be  carried  °ut. 
brief  overview  of  the  methodology  is  presented  in  the  remainder  of  this 
section.  Each  of  the  eight  elements  that  comprise  the  methodology  are  ex- 
plicitly treated  in  Sections  2.1  through  2.8,  respectively. 

As  portrayed  in  the  methodology  flow  diagram  (Figure  2.0-1),  the  multi- 
stage procedure  begins  with  the  network  sizing  task  (Step  1),  -n  which  t 
essential  communications  system  characteristics  that  wi.l  best  meet 
COMSRs  developed  for  the  EAD  force  model  are  determined.  The  SIM^E  model 
Utilized  as  the  primary  tool  for  definition  of  the  communications 

system  requirement  parameters.  ™ese  «JuiremenJS  ’ ^i^in’  S TV Ire 
teria  developed  in  Task  III,  and  the  MRTF  concepts  refined  in  Task  IV  are 

the  essential  inputs  to  the  MRTF  candidate  system  development  task  (Step 
2)  Various  implementation  approaches  will  be  conceived  and  organized  into 
alternative  MRTF  communications  systems.  Existing  and  planne  **  P ’ 
as  specified  in  Appendix  G of  Task  IV,  will  be  considered  in  formulating 
these  candidate  systems.  Concept  ALPHA,  based  on  the  Government-provided 
EAD  baseline  concept,  will  also  be  formulated,  using  existing  “d  d 

equipment.  Concept  ALPHA  will  be  derived  to  provide  a reference  sy8ta 
system  evolution  and  for  comparison  of  the  other  candidate  system.  When 
approved  by  the  Government,  the  candidate  systems  will  provide  the  major 
inputs6 to  Steps  5,  6,  and  7,  in  which  the  candidate  systems  are  evalu-^ 
ated  in  terms  of  communications  system  effectiveness,  c , 
sensitivity. 

In  Step  3 the  SIMCE  and  CASE/TI>-18  communications  system  models 
will  be  utilized  as  design  tools  to  evaluate  and  refine  each  candidate 
system.  The  models  will  be  used  for  each  concept,  and  the  results  will 
indicate  the  need  for  changes  in  system  parameters  and  configuration.  In 
Step  6,  system  analysts  will  evaluate  other  effectiveness  aspects  to  deter- 
mine possible  system  parameter  or  configuration  improvements.  In  addition, 
the  Government  will  conduct  an  EMC/EMV  analysis  that  will  be  provided  as 
input  to  the  system  evaluation  task.  The  refined  candidate  1 *S 

fined  by  their  configurations  and  associated  effectiveness,  cost,  and 
evaluation,  will  then  be  analyzed  as  to  the  parameter  varlatJ^^^8Cn 
sitivity  analysis  task  (Step  7).  The  results  of  the  cost,  effectiveness. 


and  risk  and  sensitivity  analyses  will  be  used  by  the  system  cost/effective- 
ness and  rank-ordering  task  (Stop  8),  to  refine  the  alternative  systems 
and  rank-order  them  with  sufficient  documented  rationale  to  permit  Govern- 
ment selection  of  the  preferred  system.  The  Government-preferred  system 
will  then  be  documented;  the  preferred  system  communications  support  plan 
in  Task  VI  and  the  MRTF  implementation  plan  in  Task  VII  will  be  identified. 


2.1  NETWORK  SIZING 


The  purpose  of  the  network  sizing  effort  in  Task  V will  be  to  deter- 
mine the  minimum  channel  allocations,  throughout  the  system,  that  would 
successfully  meet  the  communications  support  requirements  (COMSRs).  These 
channel  requirements  will  be  used  as  a base  from  which  system  designers 
will  determine  equipment  deployments  for  the  alternative  communications 
systems. 

Network  sizing  will  be  accomplished  by  using  S1MCE  to  determine  the 
relationship  between  channel  requirements  and  design  GOS.  An  analysis  of 
this  relationship  will  produce  LINK  GOS  upper  limit  for  system  design.  The 
results  of  sizing  will  be  the  capacity  in  channels  of  each  link  of  the  net- 
work and  equipment  allocations  for  each  unit  in  the  system. 

The  size  of  a communications  system  is  specified  by  the  locations  of 
its  nodes  and  links,  the  link  capacities,  and  the  equipment  allocations. 

To  determine  these  parameters,  the  Task  V team  will  examine  unit-to-unit 
needlines  and  channel  requirements  to  determine  the  relationship  between 
link  capacity  and  GOS. 

The  Government-furnished  information  to  be  used  for  sizing  includes: 

° COMSR  data  and  data  description 

° EAD  force  model 

* EAD  deployment 

° SIMCE  model. 

The  COMSRs  were  produced  from  the  following  sources: 

* The  Government-furnished  force  model  with  unit  name,  number, 
TOE,  and  location  tor  over  4000  units; 

* Data  forms  (completed  by  military  communications  experts) 
that  recorded,  for  each  typical  unit,  its  communications  re- 
quirements by  mode. 

This  information  was  processed  by  3 series  of  programs,  including  a 
force  model  program  to  place  the  appropriate  data  in  the  format  required  by 
SIMCE.  The  three  files  prepared  for  input  to  SIMCE  contain  specific  unit 
data,  typical  unit  names,  and  the  user  communication  requirements. 
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With  the  elimination  of  the  Field  Army  echelon,  the  CONAF  COMSR  data 
base  originally  supplied  by  the  Government  must  be  revised  for  the  new 
EAD  force  structure.  It  is  the  purpose  of  Task  XVII  to  develop  an  EAD 
COMSF  data  base  that  reflects  the  user  requirements  of  the  units  in  the 
EAD  force  structure.  The  EAD  force  model  specifies  each  individual  unit 
and  the  echelon  to  which  the  unit  belongs.  The  EAD  deployment  provides 
the  location  of  these  individual  units. 

SIMCE  will  be  used  in  network  sizing  to  provide  unit  needline  traffic 
volume,  channel  requirements,  and  GOS.  (SIMCE  is  described  in  Appendix  D. ) 
The  task  of  sizing  will  be  performed  separately  for  Theater  Army,  Corps, 
Division,  and  Separate  Brigade.  The  sizing  task  can  be  broken  down  into 
five  steps: 


Compute  unit  needline  traffic 
Compute  unit-to-unit  channel  requirements 
Determine  link  capacity-versus-GOS  curve 
Determine  equipment  allocations 
Determine  LINK  GOS  upper  limit. 


2.1.1  Compute  Unit  Needline  Traffic 


The  first  step  in  the  sizing  task  will  be  to  conduct  a SIMCE-aided 
analysis  to  determine  unit-to-unit  traffic  volume.  The  study  team  will 
identify  the  units  to  be  sized  and  the  location  of  nodes  in  the  echelon. 
SIMCE  will  be  run  to  determine  the  traffic  between  all  specific  units.  This 
information  will  then  be  used  to  identify  the  busiest  units,  relocate  nodes, 
and  determine  equipment  allocation  for  the  individual  units. 

2.1.2  Compute  Unit-to-Unit  Channel  Requirements 

The  second  step  in  the  sizing  task  will  be  to  determine  the  number 
of  channels  required  by  each  pair  of  communicating  units.  This  step  will 
use  the  unit  needline  traffic  volume  determined  in  the  first  step.  Unit- 
to-unit  channel  requirements  will  be  computed,  using  the  Erlang  B formula. 
The  analysis  will  provide  an  estimate  of  the  upper  limit  on  the  number  of 
channels  required  between  a pair  of  units. 

2.1.3  Determine  Link  Capacity-versus-GOS  Curve 

The  purpose  of  this  step  will  be  to  determine  the  sensitivity  of 
link  capacity  to  design  GOS.  SIMCE  will  be  used  to  determine  channel 
requirements  for  several  values  of  design  GOS. 

The  system  designer  will  refine  the  locations  of  nodes  and  links  in 
the  network,  using  the  unit-to-unit  traffic  from  Step  1 as  a guide.  SIMCE 
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will  then  be  run,  connecting  each  unit  to  the  nearest  node  and.  if  neces- 
sary, relocating  nodes  to  improve  design.  The  system  designer  will  input 
a routing  scheme  and  a design  GOS  to  SIMCE,  to  determine  channel  require- 
ments for  all  links  in  the  network.  The  analysis  will  be  repeated  for 
various  values  of  GOS,  to  produce  a channel  requirement-ver6us-G0S  curve. 

This  curve  will  help  the  designer  determine  the  point  at  which  a slight 
increase  in  GOS  requires  a large  increase  in  link  capacity. 

2.1.4  Determine  Equipment  Allocations 

The  unit  needline  traffic  volume  and  the  unit-to-unit  channel  re- 
quirements from  Steps  1 and  2 will  aid  in  the  determination  of  equipment 
for  individual  units.  Equipment  allocations  for  nodes  will  be  determined 
by  the  designer  after  examination  of  the  SIMCE-provided  channel  requirements 
for  links,  distances  between  nodes,  and  the  volume  of  traffic  over  each  link. 
The  designer  will  also  note  the  requirements  of  each  individual  unit  for 
secure  equipment,  to  ensure  proper  allocation  of  this  equipment.  Then  the 
recommended  equipment  for  each  unit  will  be  compared  to  the  unit’s  present 
TOE  equipment  allocation. 

2.1.5  Determine  LINK  GOS  Upper  Limit 

The  fifth  step  will  use  the  output  of  the  comparative  analysis  con- 
ducted in  Step  4 and  the  channel  capacity-versus-GOS  curve  developed  in 
Step  3 to  analyze  and  determine  the  LINK  GOS  upper  limit  to  be  used  for 
system  design.  In  Step  3,  the  link  capacity  required  to  meet  a specified 
GOS  was  determined,  and  in  Step  4,  equipment  allocations  were  established. 

The  next  step  will  be  to  combine  the  information  from  these  two  analyses 
and  determine  the  maximum  value  of  GOS  to  be  used  for  system  design.  An 
analysis  based  on  this  consideration  will  be  conducted,  and  a LINK  GOS 
upper  limit  for  system  design  will  be  determined.  This  value  of  GOS  repre- 
sents the  highest  value  of  GOS  that  the  alternative  systems  can  be  expected 
to  attain. 


2 . 2 DEVELOPMENT  OF  MRTF  CANDID\TE  SYSTEMS 

The  objective  of  this  task  is  to  develop  four  candidate  MRTF  communi- 
cations systems  that  will  be  analyzed  and  evaluated  in  Steps  3,  4,  5,  6,  and 
7 of  Figure  2.0-1  and  subsequently  refined  and  rank-ordered  in  Step  8 of 
the  diagram.  The  communications  system  dnign  will  identify  the  communi- 
cations resources  required  to  support  the  selected  concepts  and  communica- 
tions support  requirements,  by  echelon,  in  terms  of  equipment,  facilities, 
procedures,  and  system  organization.  The  task  will  assign  communications 
resources  to  establish  the  communications  networks,  communications  nets, 
special  communications  subsystems,  and  organic  communications  capability, 
in  accordance  with  established  requirements.  This  task  will  consist  of 
four  subtasks: 


■ 


1 Review  Task  IV  hardware  for  completeness  and  make  modifications 

” where  required;  provide  equipment  characteristics  for  evaluation; 

r 

2 Identify  organic  communications  support  requirements; 

3 Identify  additional  communications  support  requirements; 


4  Develop  MRTF  candidate  communications  systems. 

In  Subtask  1,  the  procurement  list  of  communications  equipment  from 
which  the  systems  will  be  configured  will  be  updated.  Each  item  of  equip- 
ment Jiose  electromagnetic  characteristics  are  required  for  input  into  the 
EMC/EMV  analysis  will  be  defined. 


In  Subtask  2,  the  organic  communications  support  requirements  for  each 
unit  will  be  identified  and  consolidated  to  permit  the  assignment  of  equip- 
ment and  resources  to  be  made  in  Subtask  4.  Identification  of  organic 
requirements  will  be  based  on!  1)  review  of  the  COMSR  data;  2)  evaluation 
of  the  output  from  the  network  sizing  tasks;  and  3)  review  of  other  require- 
ments documentation. 


Subtask  2 will  essentially  follow  the  procedure  outlined  below: 


\ 


! 


i 


& Identify  organic  communications  requirements  on  a unit  basis, 
in  accordance  with  checklists  and  tables  for  the  following. 

- Interunit  traffic  requirements 

- Intraunit  traffic  requirements 

* Review  stated  requirements  for: 

- Identification  of  duplications  and  omissions 

- Comparison  with  adopted  standards 

- Verification  of  minimum  essential  requirements. 

In  order  to  ensure  development  of  a cost/effective  system  that  minimizes 
inconsistencies  and  overequipping,  all  available  communications  means  must 
be  considered  simultaneously  when  unit  organic  requirements  are  being  deter- 
mined. The  operational  features,  limitations,  and  capabilities  of  each  of 
these  means  will  be  considered  during  resource  assignment.  The  advantage 
offered  by  this  approach  is  that  it  affords  a view  of  the  total  communica- 
tions requirements  picture  for  each  unit.  This  provides  perspective  and 
insight  to  the  evaluation  and  resource  assignment  procedure  that  would  not 
be  possible  if,  for  example,  multichannel  and  organic  requirements  were 
evaluated  separately.  Tabulation  of  all  requirements  for  each  unit  on  a 
single  record  will  facilitate  this  advantage. 

The  procedure  referenced  above  permits  assignment  of  equipment  and  re- 
sources as  soon  as  requirements  are  determined,  provided  a resource  inven- 
tory is  available. 
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The  results  to  be  produced  by  this  subtask  include  identification  of 
the  unit's  organic  requirements  in  terms  of  users,  needlines  (both  interunit 
and  intraunit),  needline  characteristics,  desired/required  telecommunications 
means,  and  communications  channel  requirements. 

Subtask  3 will  examine  identified  areas  that  require  communications 
support,  to  determine  if  special  communications  subsystems  may  be  needed  to 
satisfy  particular  requirements.  These  areas  must  first  be  identified  and 
their  specific  requirements  determined  before  various  means  can  be  proposed 
and  evaluated.  The  provision  of  a separate  communications  subsystem  must 
be  justified;  it  must  consider  the  specific  demands  for  service,  the  appli- 
cable measures  of  effectiveness,  and  available  alternate  methods  of  support. 

Several  sources  will  be  used  to  identify  areas  of  communications  sup- 
port and  their  requirements,  to  include: 

° On-site  development  of  minimum  essential  CE  requirements  with 
cognizant  agencies  (e.g..  Air  Defense  Agency); 

0 Analysis  of  pertinent  documents: 

Basic  derivative  studies  and  CE  annexes 

- Doctrinal  concepts  for  employment  of  various  weapons 

- Technological  forecasts 

- Planning  documents  and  studies; 

0 Visits  to  PMOs , obtaining  requisite  information  by: 

- Interview 

- Examination  of  support  system  documentation; 

* AMC  Electronic  System  Procurement  Conference. 

Specific  subsystems  considered  candidates  for  communications  require- 
ments analysis  in  this  subtask  include: 

0 TOS 

* TAC.FIRE 

0 CS3 

0 Air  Defense  (TSQ-73,  SAM-D,  Chaparral/Vulcan,  etc.) 

* Lance 

* Pershing 

* ATMAC 

* Weather 

0 TACASA. 

Published  information  on  these,  and  other  subsystems  projected  for 
fielding  in  the  mid  range  time  frame,  is  expected  to  be  obtained  through 
the  INTACS  COTR. 


As  these  subsystems  are  Identified  and  their  communications  require- 
ments determined,  these  requirements  will  be  analyzed  with  respect  to  the 
capabilities  of  the  organic  communications  support  to  determine  the  ade- 
quacy of  service.  Where  necessary  to  provide  required  service,  additional 
communications  subaystem  networks  will  be  configured  and  evaluated  with 
S1MCE  in  a manner  similar  to  network  sizing. 

Thu  result  . t e produced  by  this  subtask  include  the  following. 

A e of  network  topologies  that  represent  the.  additional 

r-  uaications  support  subsystems; 

" h orpanying  lists  of  communications  requirements  data  ele- 
. ts  that  describe  in  detail  the  capable*..  needed  by  these 
, jr  stems,  identifying  the  users  and  the  tyt  *»rd  amount  of 
traf'ic  to  be  carried. 

Subta3V  4 will  assign  specific  communications  .xs  ..  cop  establish 
communications  uetwo  ‘‘  , special  commir  ic'ticnr  ' ut-:"3t''ms . aV.  organic 

capability,  in  ,ccc.*.vn:t  with  established  lvquireo* 

The  arj:g.imenr  , <"'r  .dure  will  vary  with  t.ie  par'icu  ar  area  of  commu- 
nications s iport.  *ci channel  equipment  will  be  assigned  ^ased  on  the 
node  and  i,  nk  cmfigr  :*»  oip  peculiar  to  each  network.  The  equipment  must 
then  be  a stocked  . .posed  cognizant  signal  organisations.  Person- 

nel requir eme  t.  will  <\  ^e  determined  for  these  units.  Specialized 
communications  p’biystsros  vi.ll  be  developed  in  a similar  Turner.  The  pro- 
cedure for  det<  rmi'^  ..g  o ganic  requirements  leads  almost  directly  to  re- 
source selecticr . 

Once  resource;  ha'-e  baen  assigned  to  typical  units  fn  the  force  model, 
locations  can  l ■ > .t.i-.aed  by  referencing  the  deployment.  This  assignment 
step  will  erratl*  Je  .wi...  of  the  inputs  required  fo'  tiie  effectiveness, 
cost,  sensitiv  ty,  .d  Vc/EMV  analyses  in  the  sub  casks  that  follow. 

The  effort  itaive  in  this  and  subsequent  tasks  requires  a communi- 
;ations  resource  dar  ba  ;e  and  efficient  methods  of  access  to  satisfy  the 
multiple  dema'ds  for  such  information  throughout  the  course  of  the  study. 
The  large  number  of  nodes,  units,  equipment  types,  and  alternative  con- 
cepts will  generate  a substantial  amount  of  manual  work. 


The  output  of  this  task  will  be  the  candidate  communications  support 
systems  described  in  terms  of  the  elements  listed  belcw.  They  will  be  con- 
sidered tentative  configurations,  pending  the  outcome  >.1  the  EMC/EMV  and 
cost  and  effectiveness  analysis  to  be  conducted  in  ti..'  following  subtasks: 

0 Identify  users  by  name,  unit,  echelon,  location; 

0 Identify  the  number,  nomenclature,  func  ion,  characteristics, 
and  cost  of  each  type  of  equipment; 
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° Identify  and  configure  the  radio  nets,  multichannel  subsystems, 
and  special  subsystems  for  each  candidate  system  in  terms  of 
users,  user/equipment  assignments,  and  user/equipment 
interconnectivity ; 

0 Define  the  connectivity  and  configuration  procedures  by  which 
the  communications  equipment  is  operational ly  deployed; 

Define  the  operational  procedures  and  techniques  under  which 
the  system  will  be  required  to  operate; 

° Identify  the  quantity  and  type  of  personnel  required  to  main- 
tain and  operate  the  system. 

The  iterative  nature  of  this  task  is  indicated  in  Figure  2.0-1  by  the 
feedback  loop  from  the  output  of  the  system  effectiveness  analysis  (Step 
6)  and  tradeoff  analysis  (Step  8).  Feedback  data  will  include  the  design 
deficiencies  and  limitations  identified  for  each  option,  and  will  Indicate 
the  need  for  a revision/modification  of  the  particular  candidiate  system 
design. 


2.3  COMPUTER  SIMULATION  ANALYSIS 

The  two  computer  simulation  models  (CASE  and  SIMCE)  will  be  used  to 
evaluate  the  following  measures  of  effectiveness: 

° Grade  of  service 

° Speed  of  service 

° GOS  luss  due  to  nodal  destruction 

° Ability  to  adapt  to  various  ratios  of  traffic  types. 

Section  2.6  outlines  the  manner  in  which  the  MOEs  will  be  used  in  the  INTACS 
evaluation.  Appendix  A defines  these  MOEs,  and  in  four  specific  instances, 
refers  to  the  use  of  the  network  models  for  their  evaluation. 

2.3.1  Evaluation  of  Grade  of  Service 


Both  SIMCE  and  CASE  will  be  used  to  evaluate  GOS.  It  is  expected 
that  each  will  reinforce  the  other  model,  and  if  this  is  true,  the  results 
of  the  CASE  analysis  will  be  used  for  the  MOE.  Each  model  has  features 
common  to  the  other  and  features  not  contained  in  the  other.  Thus,  evalua- 
tion by  both  models  will  ensure  complete  consideration  of  system  contribu- 
ting factors  to  GOS.  Both  models  evaluate  COS  for  TP  and  TTY  traffic; 

SIMCE  also  computes  GOS  for  data,  and  is  being  enhanced  by  the  Army  to 
compute  GOS  for  net  radio. 
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2. 3. 1.1  CASE 


For  IP  traffic,  CASK  will  simulate  the  generation  of  messages  and 
count  the  number  of  blocked  messages.  COS  is  calculated  as  the  probability 
that  a message  is  not  blocked.  Blockage  occurs  in  any  of  the  following 
instances  : 

0 An  operator,  or  plug,  is  not  available  at  one  cf  the  nodes 
along  the  route; 

° A link  channel  is  not  available; 

° A loop  channel  is  not  available  between  the  node  of  des- 
tinat  on  and  rhe  unit  of  destination; 

e r.w  TP  is  bu"-y  at  the  unit  of  destination. 

CASF.  simulates  automatic  switchboards  by  eliminating  the  constrain- 
ing characteristic0  of  manual  switchboards,  the  number  of  operators,  and 
the  operator  reaction  time.  This  is  accomplished  by  providing  enough  opera- 
tors to  immediately  service  all  calls  and  by  specifying  a minimal  operator 
reaction  time. 

CASE  permits  rerouting  in  the  event  of  blockage  at  a node.  In 
this  instance,  blockage  occurs  (for  system  COS)  only  if  all  reroutes  fail. 
GOS  for  the  system  (total  network)  will  be  computed.  Though  not  part  of 
the  MOE,  unit- to-unlt  GOS  will  be  recorded  to  ensure  that  satisfactory 
service  is  provided  to  every  user. 

CASE  simulates  TTY  traffic  in  a separate  model.  Messages  are 
not  blocked,  but  remain  in  queue  until  a connection  is  successfully  estab- 
lished for  transmission.  A message  completion  rate  is  calculated  tor  the 
system  by  dividing  the  total  number  of  completed  messages  by  the  total 
number  of  messages  generated.  The  difference  between  these  two  numbers 
is  accounted  for  by  the  messages  remaining  in  queue  or  still  being  proces- 
sed at  the  end  of  the  simulation.  No  messages  are  assumed  lost.  This 
ratio  is  considered  the  GOS  for  TTY  traffic. 

2. 3. 1.2  S1MCE 

tlMCE  provides  link  GOS  for  the  following  circuit  types; 

° Data,  common  user,  secure 
° Data,  common  user,  nonsecure 
0 TP,  common  user,  secure 
* TP,  common  user,  nonsecure 
0 TTY,  common  user,  secure. 

No  actual  simulation  is  performed  for  TP,  TTY,  and  data  traffic.  GOS  is 
calculated  for  common  user  circuits  only,  using  the  Erlang  B ormula  an 
considering  traffic  requirements  and  link  capacities. 
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SIMCE  considers  the  command  network  separately  from  the  area  net- 
work, and  considers  Theater  Army  separately  from  Corps  and  below.  Thus, 
four  separate  runs  are  required  to  obtain  GOS  for  the  entire  system.  Sys- 
tem GOS  is  obtained  from  link  GOS  when  the  links  are  weighted  according 
to  traffic  requirements. 

GOS  is  also  provided  for  net  radio  by  SIMCE  enhancement,  a call-by- 
call simulation  of  a net  radio  system.  First,  the  model  provides  typical 
unit  single-channel  needlines  by  mode,  precedence,  frequency,  length,  and 
purpose  (e.g. , TUN  6 to  TUN  7,  voice,  6 routine  messages,  average  length  40 
seconds,  administrative).  Communications  analysts  will  identify  the  single- 
channel  nets  available  to  each  unit  and  specify  the  net  to  be  used  for  each 
needline.  SIMCE  randomly  generates  the  appropriate  number  of  messages  for 
each  net  for  the  time  period  to  be  simulated.  If  the  net  is  not  available 
when  the  message  is  to  be  sent,  it  enters  a queue  for  that  net.  At  the  end 
of  the  simulation,  statistics  are  provided  by  net  on  the  total  number  of 
messages  that  were  queued.  This  provides  the  GOS. 

2.3.2  Evaluation  of  Speed  of  Service 

Speed  of  service  for  TP  and  TTY  traffic  can  be  measured  only  by  CASE. 
The  model  does  not  include  store-and-forward  switches  and  does  not  evaluate 
speed  of  service  for  data.  For  TP  traffic,  CASE  totals  delay  time  at  the 
node  in  terms  of  two  factors: 

0 Queueing  time  (the  waiting  time  for  an  available  operator  or 
plug;  if  over  20  seconds,  the  call  is  dropped); 

° Seize  time  (the  reaction  time  required  by  an  operator  to 
seize  a plug  and  insert  it  into  the  switchboard. 

Required  input  data  includes  switchboard  characteristics,  such  as  the 
number  of  plugs.  Manual,  semiautomatic,  and  automatic  switchboards  can  be 
simulated.  SOS  by  precedence  Is  not  calculated  for  TP  traffic.  

For  TTY  traffic,  CASE  totals  activity  times  for  message  handling  by 
communications  center  personnel.  These  personnel  are  the  message  center 
clerk,  the  clerk  who  prepares  the  message  for  transmission,  the  transmitting 
operator,  and  the  receiving  operator.  Statistics  indicating  SOS  by  prece- 
dence are  provided.  This  output  will  be  compared  with  JCS  standards  to 
obtain  the  value  of  the  MOE. 


2.3.3  Evaluation  of  GOS  Loss  Due  to  Nodal  Destruction 

This  MOE  is  the  reduction  of  system  GOS  due  to  destruction  of  the 
busiest  node.  SIMCE  will  be  used  for  the  evaluation. 


The  busiest  node  will  be  identified  and  removed  from  the  network. 
Units  attached  to  the  destroyed  node  will  not  be  reassigned  to  another 
node,  since  a lengthy  time  interval  would  be  required  by  a signal  organi- 
zation to  perform  this  operation.  After  a node  is  destroyed,  two  possible 
situations  exist,  depending  upon  the  knowledge  of  the  users  of  the  the  sys- 
tem regarding  the  nodal  destruction: 


° Foreknowledge  - each  user  in  the  systpm  is  aware  of  the 

destruction  of  the  node,  and  messages  are  rerouted  to  avoid 
that  node; 

° No  foreknowledge  - messages  are  blocked  at  the  destroyed 
node,  and  the  previously  connected  units  continue  to  gene- 
rate traffic. 

Normally,  most  network  users  will  be  instantly  aware  of  the  total  des- 
truction of  a node;  therefore,  foreknowledge  will  be  assumed  in  the  evalua- 
tion of  this  MOE.  SIMCE  will  be  run  without  the  busiest  node  to  obtain  a 
new  system  GOS.  This  process  of  identifying  and  destroying  the  busiest  node 
and  then  measuring  the  impact  of  that  destruction  is  reiterated  until,  in 
the  judgement  of  the  communications  analysts,  the  communications  system 
fails  to  provide  minimal  acceptable  service. 

2.3.4  Evaluation  of  the  Ability  to  Adapt  to  Various  Ratios  of  Traffic  Types 

SIMCE  will  be  used  to  measure  the  change  in  GOS  when  data  traffic  is 
increased  at  the  expense  of  voice  traffic. 

The  system  busy  hour  will  be  identified  from  COMSR  data.  Communica- 
tions analysts  will  convert  traffic  volume  by  mode  to  a common  denominator, 
to  determine  percentages  of  traffic  by  mode. 

For  the  purposes  of  this  MOE,  once  these  percentage  levels  are  estab- 
lished, system  COS  will  be  calculated  by  weighting  (according  to  the  percen- 
tages) the  separately  calculated  values  of  GOS  by  mode.  Then  the  percentage 
of  data  traffic  will  Vie  increased  at  the  expense  of  voice,  and  new  values  of 
GOS  will  be  calculated  for  both  data  and  voice.  These  new  values  will  be 
used  for  the  calculation  of  a resultant  system  GOS.  This  process  will  be 
repeated  to  develop  a curve  of  GOS-to-percent  data. 

For  the  MOE,  data  will  replace  voice  on  a one-to-one  basis.  However, 
this  ratio  will  be  varied  in  a sensitivity  analysis. 


2.4  COST  ANALYSIS  METHODOLOGY 


The  cost  analysis  will  produce  the  cost  information  and  estimates  re- 
quired in  Tasks  V,  VI,  and  VIT  of  the  INTACS  program.  The  objectives  of 
this  analysis  are  to: 

° Provide  the  system  designers  with  an  initial  evaluation  of 
the  likely  life-cycle  costs  of  the  alternative  system  designs 
and  an  identification  of  those  factors  that  contribute  to  sig- 
nificant cost  differences  among  the  alternatives; 

° Provide  the  decision-maker  with  a ranking  of  the  alternatives 
on  the  basis  of  their  life-cycle  costs. 

Basic  assumptions  and  guidelines  used  in  developing  the  cost  analysis 
methodology  are  presented,  along  with  two  cost  approaches:  one  aimed  at 
estimating  total  life-cycle  costs  of  alternatives  to  aid  in  selecting  a 
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preferred  concept,  and  one  to  aid  in  programming,  budgeting,  and  controlling 
the  preferred  alternative  system  concept.  These  approaches  are  discusse 
fully  in  Subsections  2.4.1  and  2.4.2,  respectively. 


The  methodology  presented  in  this  section  has  been  developed  in  accor- 
dance with  USACDC  Pamphlet  11-1  and  AR  37-18.  Cost  methodology,  cost  factors, 
and  CERs  used,  and  formats  for  presentation  of  cost  data,  will  be  cont  r.u 
ously  reviewed  by  a US  Andy  cost  analysis  activity  to  be  designated  by  the 
COR.  Cost  estimates  developed  for  use  in  the  cost  effectiveness  analysis 
will  be  provided  to  the  same  US  Army  cost  analysis  activity  for  review  and 

validation. 


Task  V will  develop  a candidate  communications  system  for  each  alter- 
native concept  and  perform  cost,  effectiveness,  and  sensitivity  analyses  to 
recommend  a preferred  system.  Task  VI  will  produce  a detailed  communications 
support  plan  based  on  the  Government's  selection  of  a preferred  system.  For 
this  plan,  manpower  and  training  costs  for  the  specified  organizations  are 
required,  along  with  adjusted  procurement  and  inventory  costs  (based  on 
identified  equipment  needs  and  inventory  shortfalls)  to  aid  in  refining 
materiel  program.  A subset  of  the  described  LCC  methodology  will  be  used 
to  determine  these  costs. 


In  Task  VII,  yearly  costs  will  be  required  for  programming,  budgeting, 
and  control  purposes.  The  methodology  for  time-allocated  costing  will  be 
used  to  produce  these  cost  estimates.  The  following  assumptions  and  guide- 
lines were  used  during  the  development  of  the  cost  methodology  and  are 
recommended  for  application  in  Task  V: 


8 In  accordance  with  the  guidelines  set  forth  in  DoDI  7041.3, 
all  R&D,  investment,  and  operating  costs  will  be  expressed  in 
current  fiscal-year  dollars.  Discounting  will  be  based  on  an 
annual  rate  of  10  percent,  as  specified  by  DoDI  7041.3.  Dis- 
counting is  necessary  if  costs  incurred  in  future  years  are  to 
be  expressed  in  current  fiscal-year  dollars; 

0 Costs  incurred  prior  to  the  current  fiscal  year  will  be  con- 
sidered sunk,  and  will  not  be  included  in  LCC  calculations. 
While  not  included  in  the  LCC,  the  sum  costs  will  be  provided 
for  information; 

0 Baseline  costs  will  be  analyzed  using  an  "average"  (expected 
value)  estimate; 

8 Learning  curves  will  be  applied  to  production  cost  estimates  to 
adjust  for  quantity  production  where  historical  unit-cost  est 
mates  are  based  on  other  than  expected  production  quantities; 

0 Past  experience  with  communications  systems  studies  have  shown 
that,  compared  to  the  life-cycle  cost  of  the  whole  system,  the 
salvage  value  of  the  equipment  being  phased  out  is  negligible, 
and  therefore  will  not  be  considered; 

8 Peacetime  operations  will  be  used  as  a baseline  in  calculating 
operating  costs; 
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° Costs  of  existing  facilities  and  equipment  will  be  included 
only  when  the  asset  has  planned  alternative  use  or  is  intended 
to  be  sold  (the  fair  market  value  will  be  used  to  cost  such 
assets) ; 

° Cost  uncertainties  will  be  addressed  through  sensitivity 
analysis  to  determine  changes  in  total  LCC  produced  by  a 
deviation  in  input. 


2.4.1  Approach  to  Life-Cycle  Costing 

It  is  a well-accepted  premise  that,  in  comparing  cost  of  alter- 
natives, one  must  consider  all  costs  incurred  over  the  lives  of  the 
alternatives  rather  than  just  the  initial  outlays  or  procurement  costs. 

If  costs  and  benefits  of  the  alternatives  are  reasonably  well-known  and 
can  be  quantified  in  some  common  unit  (dollars),  one  can  choose  an  alter- 
native on  the  basis  of  cost  differences.  The  costs  and  benefits  common 
to  all  alternatives  may  be  ignored  as  irrelevant  to  the  decision  to  be 
made. 


In  Task  V,  however,  the  alternatives  do  not  offer  benefits  (e.g., 
effectiveness)  that  can  be  quantified  in  terms  of  dollars.  It  is  possible, 
moreover,  that  a large  fraction  of  total  system  costs  are  not  common  among 
alternatives;  therefore,  for  ease  of  computation  and  to  reduce  the  chance 
of  omitting  a cost  difference,  all  life-cycle  costs  for  each  alternative 
will  be  considered. 

Costs  common  to  alternatives  will  reduce  the  computational  work- 
load, since  they  need  to  be  computed  only  once  for  the  baseline  concept 
and  are  then  available  for  costing  of  the  alternative  concepts. 

The  structure  of  the  LCC  model  has  been  determined  by  two  factors: 
the  form  of  the  required  output  and  the  availability  of  current  and  histo- 
rical information  as  input.  The  total  LCC  is  broken  into  the  following 
three  basic  categories: 

0 Research  and  development  (R&D)  cost 
° Investment  cost 

Operation  and  maintenance  (O&M)  cost. 


Cost  breakdown  structures  for  these  categories  are  presented 
in  Table  2.4-1.  Appendix  B provides  the  specific  formula,  cost-estimating 
relationships  (CERs),  or  criteria  used  to  estimate  each  cost  element 
in  the  LCC  model.  The  cost  data  base  required  by  the  LCC  model  is  ad- 
dressed in  Subsection  2.4.3,  and  applicable  documentation  is  listed  in 
Appendix  C. 
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Operation  and  Maintenance  Coat 


Based  on  the  CERs  presented  in  Appendix  B,  estimates  of  the  life- 
cycle cost  of  each  alternative  will  be  developed.  The  costs  of  the  alter- 
natives will  be  compared,  and  those  system  characteristics  that  contribute 
to  cost  differences  will  be  identified. 


The  results  of  this  analysis  will  be  presented  to  the  system  design- 
ers. Particular  emphasis  will  be  placed  on  identifying  those  system  char- 
acteristics that  contribute  to  major  cost  differences  among  the  alterna- 
tives. Based  on  these  results,  the  designers  will  attempt  to  modify  the 
initial  designs  to  reduce  costs.  As  modifications  are  developed  by  the 
designers,  their  effect  on  life-cycle  costs  will  be  calculated  by  the  cost 
analysts.  This  iterative  process  will  continue  until  the  designers  believe 
system  costs  are  at  their  lowest  values  consistent  with  sound  engineering 
practice,  operational  requirements,  and  effectiveness  considerations. 


2. A. 2 


>roach  to  Time- Allocation  of  Costs 


Once  a preferred  communications  system  support  plan  has  been  defined, 
it  is  necessary  to  develop  a schedule  and  procedure  to  implement  the  plan. 
Time-oriented  cost  estimates  are  necessary  for  budgeting  and  programming 
funds  to  control  the  Implementation  process.  The  objective  of  Task  VII  is 
to  develop  this  implementation  plan  for  the  preferred  concept,  and  the 
time-allocation  cost  procedures  described  below  are  designed  to  supply 
needed  cost  estimates. 


The  time-allocation  cost  model  was  designed  for  producing  budgetary 
cost  estimates.  The  Inputs  available  to  the  model  are  similar  to  those 
for  the  life-cycle  cost  tradeoff  model.  The  basic  Inputs  consist  of  the 
detailed  time-phased  implementation  and  support  plans  containing  required 
equipment,  manpower,  and  materiel,  plus  actions  required  to  field  the  sys- 
tem on  a year-by-year  basis.  The  data  base  available  is  basically  the 
same  as  that  for  life-cycle  costing. 


The  basic  individual  elements  identified  in  the  life-cycle  cost 
section  (Table  2.4-1)  also  represent  the  basic  components  of  budgetary 
costs.  More  aggregate  budget  classifications  do  not  coincide,  however, 
with  the  major  life-cycle  cost  categories. 


Budget  classifications  are  obtained  from  DoD  Manual  7110- 1-M,  wh<.le 
Table  2.4-2  contains  a list  of  applicable  budgetary  functional  titles  und 
their  subdivisions.  Not  all  of  the  subdivisions  will  be  relevant  to  '.he 
communications  support  plan  being  considered,  but  all  relevant  life-cycle 
cost  elements  will  be  aggregated  into  one  of  the  functional  divisions,  sub- 
divisions, or  lower-level  budget  activities. 


While  the  output  of  the  time-allocation  model  must  be  useful  in 
budgeting  and  control,  it  need  not  be  in  final  form  for  submittal  to  the 
DoD  budget.  The  output  of  the  model  will  not,  in  general,  be  in  the  form 
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TABLE  2.4-2 

Relevant  Budget  Functional  Titles 
and  Their  Subdivisions 


Military  Personnel 
Active  forces 
Reserve  forces 

Retired  Military  Personnel 

Operation  and  Maintenance 

Procurement 
Ai rcraf t 
Missiles 
Ships 

Combat  vehicles,  weapons,  and  torpedoes 
Ordnance,  vehicles,  and  related  equipment 
Other  procurement 

Research,  development,  test,  and  evaluation 
Military  sciences 
Aircraft 
Missiles 

Military  astronautics 
Ships  and  small  craft 

Ordnance,  combat  vehicles,  and  related  equipment 
Other  equipment 

Program-wide  management  and  support 
Emergency  fund 

Military  Construction 


of  budget  program  elements,  but  rather  in  the  form  of  components  of  these 
program  elements  and  functional  categories  that  can  be  aggregated  for  bud- 
getary purposes.  These  outputs  will  be  in  current-year  dollars  and  on  a 
year-by-year  basis.  They  must  then  be  inflated  or  reduced  by  appropriate 
price-index  factors  for  budgetary  purposes  or  discounted  by  the  appropriate 
factors  and  summed  to  give  total  discounted  costs. 

The  following  is  a list  of  time-allocation  cost  model  outputs  for 
each  year  required  for  budgetary  purposes: 

Test  and  evaluation  costs 
0 Training  costs 

Equipment  procurement  costs 
Research  and  development  costs 
0 Manpower  costs 
0 Operating  costs 

Logistical  support  costs. 

The  equations  required  to  compute  these  outputs  are  given  in  Section  2.0 
of  Appendix  B. 

2.4.3  Cost  Data  Base 

The  data  base  required  in  the  life-cycle  costing  procedure  consists 
of  numerous  documents  available  at  Martin  Marietta,  Booz-Allen,  and  the 
U.S.  Army  Electronics  Command  at  Fort  Monmouth,  New  Jersey,  as  listed  in 
Appendix  C.  These  documents  generally  contain  necessary  unit  cost  esti- 
mates, personnel  pay  and  training  rate  schedules,  equipment  descriptions, 
and  cost  factors  and  CERs  for  estimating  relevant  cost  elements  for  each 
equipment  and  personnel  type.  In  addition  to  the  information  contained  in 
the  documents  listed  in  Appendix  C,  data  from  concurrent  tasks,  Government- 
furnished  documents,  and  contractor  bids  and  estimates  will  also  be  used 
as  sources  of  cost  estimates  and  information.  Each  relevant  cost  element 
will  be  estimated  using  the  best  available  data. 

A review  of  the  equipment  lists  prepared  during  Task  IV  shows  that 
cost  estimates  for  most  of  the  equipment  will  be  directly  available  or 
can  be  derived  on  the  basis  of  past  experience  with  items  of  similar  nature 
and  complexity.  If  an  estimate  is  based  on  analogy,  the  items  used  as  a 
data  base  will  be  documented  along  with  a summary  of  assumptions  used,  dif- 
ferences between  the  analogous  items  and  the  item  estimated,  and  how  such 
differences  were  treated. 

For  most  cost  estimates,  some  degree  of  uncertainty  will  exist;  there- 
fore, the  cost  estimates  will  be  stated  in  terms  of  the  most  likely  value 
the. lowest  value,  and  the  most  pessimistic  (highest)  value.  A statement 
t at  identifies  areas  of  uncertainty  and  the  degree  of  uncertainty  associ- 
ated  with  the  estimate  will  also  be  included. 

[I  I 
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2.4.4  Coat  Sensitivity  Analysis 

In  general,  sensitivity  analysis  is  a means  of  considering  uncer- 
tainty. In  Task  V,  some  of  the  input  parameters  (e.g.,  cost  factors  and 
estimates)  will  be  fairly  well-known,  while  others  may  consist  of  the 
"best  guess"  over  a wide  range  of  possible  values.  The  results  of  the 
baseline  analysis  using  best  estimates  may  point  out  certain  key  a38^P* 
tions  or  input  parameters  that  impact  highly  on  the  results.  Also,  littl 
may  be  knovm  about  a set  of  inputs,  so  that  estimates  may  be  subject  to 
larger  error.  These  are  the  assumptions  and  inputs  that  must  be  subject 
to  sensitivity  analysis. 

Cost  sensitivity  analysis  consists  of  changing  an  assumption  or 
an  input  parameter  by  a specified  amount  and  determining  the  effect  this 
has  on  the  estimate  of  total  life-cycle  cost.  Each  sensitivity  analysis 
will  consist  of  selecting  the  assumption  or  parameter  to  be  varied,  deter- 
mining the  equipment,  organizations,  and  cost  categories  affected  by  the 
change,  and  calculating  the  resultant  estimated  costs  for  each  of  the 
affected  categories. 

Sensitivity  analysis  will  aid  in  selecting  the  preferred  alterna- 
tive by  providing  the  tradeoff  analysis  with  the  life-cycle  cost  of  alter- 
native concepts  under  different  sets  of  assumptions  and  estimates  of  input 

parameters. 

Some  possible  candidate  subjects  for  sensitivity  analysis  include 
the  number  of  operators  and  maintenance  personnel  required  under  alterna- 
tive concepts;  unit  cost  estimates  for  equipment  in  the  conceptual  stage 
of  development;  and  research  and  development  costs  for  nonexistent  equ  p- 
ment.  Specific  subjects  of  sensitivity  analysis  will  be  determined  in  tne 
Task  V cost  analysis  and  from  Government-provided  parameters. 


2.4.5  Cost  Constraint  Methodology 


It  must  be  emphasized  that  the  cost  constraint  considerations  do  not 
constitute  a "design  to  cost"  procedure,  in  any  sense  of  the  phrase.  e 
INTACS  design  procedure,  in  keeping  with  the  INTACS  Statement  of  Work,  is  by 
definition  unconstrained,  inasmuch  as  the  objective  is  to  design  and  recom- 
mend a mid  range  time  frame  system  that  meets  the  communications  suPPort 
requirements  (COMSRs)  with  maximum  effectiveness  and  at  minimum  cost.  The 
cost  constraint  considerations,  which  are  based  on  guidance  provided  by  the 
SAG,  are  included  in  order  that  the  Army  can  be  assured  that  the  resultant 
recommended  system  is  fiscally  obtainable  within  a reasonable  acquisition 

period. 


Three  types  of  cost  constraints  will  be  applied  in  the  evaluation  of 
mid  range  time  frame  alternative  systems: 

° "Ballpark"  system  cost  constraints 
° Target  system  life-cycle  cost  constraints 
° Time-allocated  cost  constraints. 
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The  re,  ulonship  between  spate n bardwete^coe t ^and^gr.de  office 
stralnt  cos'te,  it  provides  the  system  designer  with 

the  GOS  to  which  he  will  design. 

The  second  cost  constraint  providee  the  sy.te.  cost 

and  planner  with  a target  system  life-cycle  cost,  to  which 
costPof  Che  candidate  systems  will  be  coopered. 

4 ..  .he  *- im#>-allocated  cost  constraint,  is  the 
The  third  cost  constraint,  th  Task  VII:  MRTF 

yearly  communications  budget  constraint  that  will  be 
Communications  System  Implementation  Planning. 

Five  basic  steps  must  be  followed  in  employing  these  cost  constraints 

within  Task  V: 

• The  first  step  is  to  determine,  by  network  siring  ana^19’ 

the  functional  relationship  between  gr;de 

ofCservlce!  ^‘^Twill  remain  constant. 

• The  second  step 

designed, SbasedCon°the  projected  cost/GOS  relationship. 

• The  third  step  is  to  design  the  three  candidate  systems  to 
meet  this  grade  of  service. 

• - tirfe”rcirdcon£r^i«sTodmde:ttethr 

t'sk  objective  of  ''maximum  effectiveness  at  minimum 
cost". 

0 Th-  fifth  and  final  step  is  the  development  of  the  mid 
range1 time3 frame  Implementation  plan  based  on  the  annual 
cost  constraint. 

2. 4. 5.1  Ballpark  Cost  Constraint 

As  stated  previously,  the  ballpark  •*«- ^“^“"toS^’tool 
used^n  c^M^model.  To  conduct  thi.  analysis, 

three  basic  inputs  are  used: 

• Tya’ uatiop118  (The  “^I'uTit" 

three  types  of  force  units:  combat,  combat  support,  and 

combat  service  support.) 

0 The  COMSRs  are  input  to  the  model. 
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0 The  SIMCE  model  is  then  run,  varying  the  input  grade  of 
service  required  between  units.  Based  on  thi.9  sequence  of 
runs,  channel  capacity  versus  GOS  curves  are  developed. 

Concurrently,  for  each  of  the  typical  units  selected,  the  unit's  capacity 
to  tnnsmit/receive  information  (as  measured  by  the  number  of  terminal  I/O 
devices  that  he  possesses)  is  determined  in  erlangs.  The  quantitative 
cost  of  the  typical  unit's  terminal  I/O  equipment  is  determined.  In 
addition,  the  percentage  of  the  total  unit  communications  hardware  cost 
is  determine.  The  relationship  between  the  channel  capacity  (in  erlangs) 
and  cost  is  established  and  averaged  over  the  set  of  typical  units,  and 
the  relative-cost/present-cost  versus  GOS  curves  are  developed.  These 
curves  then  establish  the  functional  relationship  between  the  basic  three 
variables:  relative  cost  in  dollars,  grade  of  service,  and  the  COMSRs 
(where  the  COMSRs,  as  stated  earlier,  remain  constant). 

The  relationships  are  provided  to  the  Government  for  a decision 
on  the  design  GOS  that  the  mid  range  time  frame  systems  are  to  meet. 

2 . 4 . 5 . 2 Life-Cycle  Co3t  Constraint 

Testing  and  refinement  of  candidate  mid  range  time  frame  systems  to 
a life-cycle  cost  constraint  depends  upon  the  definition  of  the  Government- 
provided  cost  constraint.  As  a minimum,  the  life-cycle  cost  constraint  must 
be  a target  figure  with  a variance  in  percent.  The  total  life-cycle  cost 
must  be  broken  down  into  types  of  funds  (RDT&E,  MPA,  PEMA/OPA,  OMA)  by  cost 
limitation.  In  Subtask  4,  the  cost  analyst  determines  and  compares  the  cost 
of  the  candidate  systems,  identifying  excessive  costs  and  areas  of  system 
design  which  attribute  to  these  costs.  Based  on  the  results  of  the  cost 
analysis,  the  system  designer  ref ines/raodif ies  the  areas  of  system  design 
that  will  reduce /minimize  cost.  The  system  designer  then  resubmits  his  de- 
sign to  the  cost  analyst  for  comparative  analysis. 


2.5  RISK  ANALYSIS  METHODOLOGY 


A risk  analysis  is  performed  because  the  selection  of  a preferred 
alternative  based  only  on  consideration  of  cost  and  effectiveness 
figures  could  lead  to  erroneous  conclusions.  Thi9  possibility  exists  be- 
cause the  implementation  of  an  alternative  system  may  require  development 
of  new  equipments  not  currently  available  in  the  civilian  or  military 
inventories. 


In  carrying  out  such  development,  it  is  possible  that  equipment  with 
the  required  characteristics  cannot  be  developed  within  the  time  period 
involved.  The  probability  that  this  may  occur  is  related  to  the  value  of 
the  risk  figure  of  merit,  which  is  designed  to  flag  potential  problems  in 
the  realization  of  an  equipment.  Based  on  an  examination  of  the  equipment 
list  approved  by  SAG,  no  technical  risk  is  associated  with  the  equipment  to 
be  considered  for  the  mid  range  time  frame  (i.e.,  the  risk  is  considered  to 
be  zero).  All  equipment  is,  at  present,  technically  feasible,  and  time  is 
not  considered  a risk  in  terms  of  equipment  availability  for  the  MRTF. 
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2.6  SYSTEM  EFFECTIVENESS  ANALYSIS 


This  section  provides  the  fundamental  approach  taken  by  the  study  team 
In  establishing  a sound  methodology  and  generating  reasonable  criteria  that 
will  permit  the  orderly  evaluation,  comparison,  and  ranking  of  proposed 
alternative  concepts. 

The  section  summarizes  the  areas  of  effectiveness,  aspects,  and  mea- 
sures of  effectiveness  proposed  for  employment  in  the  analysis  of  INTACS 
alternatives.  Each  area  is  presented,  along  with  the  aspects  directly  re- 
lated to  the  evaluation  of  the  INTACS  alternatives.  Quantitative  measures 
of  effectiveness  (MOEs)  are  derived  for  those  aspects  that  can  be  quantified. 

Qualitative  MOEs  are  proposed  for  aspects  where  quantification  is  im- 
practicable. In  these  instances,  a systematic  (albeit  qualitative)  proce- 
dure is  proposed  for  evaluating  each  alternative.  With  reference  to  quali- 
tative aspects,  appropriate  questions  will  be  posed,  the  answers  to  which 
are  expected  to  distinguish  the  alternatives.  Responses  will  be  converted 
to  a dimensionless  value  within  a predetermined  scale  (e.g.,  1 to  10) 
assigned  for  formal  group  concensus  and  based  on: 

° The  difference  between  the  proposed  alternative  and  the  base- 
line system; 

0 Subjective  opinion  on  the  increase  or  decrease  in  system  effec- 
tiveness resulting  from  this  difference. 

The  aspects  and  areas  of  effectiveness  result  in  quantitative  and 
qualitative  assessments  of  the  system's  capabilities.  These  assessments, 
which  have  a multitude  of  dimensions,  must  be  reduced  to  the  single,  dimen- 
sionless quantity  used  to  rank-order  the  communications  system  concepts. 

This  single  number  also  facilitates  comparison  of  a large  number  of  unre- 
lated pieces  of  information  on  each  alternative.  The  single  quantity,  or 
system  utility,  is  not  meant  to  be  the  final  result  of  the  effectiveness 
analysis,  but  to  be  used  in  conjunction  with  two  other  outputs:  sensitivity 
analysis  and  the  identification  of  underlying  factors  that  contribute  to 
the  system  utility.  Together,  these  outputs  will  be  employed  in  the  rank- 
ordering of  the  system  alternatives. 

In  ordinary  terms,  the  basic  approach  can  be  stated  simply  as  an  en- 
deavor to  quantify  areas  and  aspects  (if  feasible),  and  resort  to  qualita- 
tive scaling  of  aspects  where  quantification  is  not  feasible  (relying  on 
the  judgement  of  qualified  experts).  The  final  step  in  the  approach  will 
be  the  coherent  use  of  the  measurements  by  a system  utility  measurement 
procedure  to  arrive  at  a figure  of  merit  for  determining  priorities  of 
alternatives. 
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Areas  of  effectiveness  are  broad  categories  of  capability  relevant 
to  the  system  alternatives  to  be  evaluated  and  the  operational  situations 
within  which  they  are  to  be  analyzed.  Fourteen  such  areas  were  specified 
for  analysis: 

° Quality  of  service 
° Mobility 
° Transportability 
° Vulnerability 
Survivability 
° Flexibility 

* Reliability 

° Logistical  support 
° Security 
° Operability 
° Standardization 
° Maintainability 

* RF  spectrum  requirements 

0 Electromagnetic  compatibility. 

After  determining  the  pertinent  areas  of  effectiveness,  aspects 
within  each  area  were  selected  on  the  basis  that: 

0 The.  aspects  are  important  considerations  within  the  area; 

Evaluation  of  the  aspects  will  distinguish  the  concepts  at 
the  system  level  or  at  the  echelons  of  brigade,  division, 
or  higher. 

Once  the  aspects  were  identified,  consideration  was  given  to  the 
specific  features  within  each  aspect  that  contribute  significantly  to 
evaluation  of  the  aspect  and  differentiation  of  the  concepts.  If  the  fea- 
ture could  be  quantitatively  measured  (with  data  and  models  available  to 
this  project),  a quantitative  MOE  was  specified.  If  the  feature  was  either 
qualitative  in  nature  or  required  subjective  estimation  of  a quantitative 
value,  then  the  methodolog”  for  highlighting  the  feature  was  specified.  Commu- 
nications analysts  will  assign  a qualitative  MOE  to  each  concept,  indicating 
the  resultant  degree  of  improvement  or  degradation  m system  performance 
(from  the  baseline  concept).  The  MOEs  are  listed  in  Subsection  2. 6.2. 3 and 
defined  in  Appendix  A.  Also,  Appendix  A specifies  the  estimation  techniques 
and  assumptions  employed  in  the  development  of  each  MOE. 

Some  MOEs  will  be  evaluated  by  examining  performance  in  specific 
situations  provided  in  a communications-oriented  scenario.  The  scenario 
involves  a fixed  deployment  of  a Theater  Army  in  a mid-intensity  combat  en- 
vironment in  Europe.  Communications  needlines  have  been  determined,  user 


/ 


[ i 


; 

| 

I i 

i 


J 

; 

1 


communication  requirements  have  been  estimated,  and  unit  and  system  busy 
hours  have  b^en  identified.  Each  concept  will  be  sized  to  satisfy  communi- 
cations requirements  based  on  this  scenario.  Situations  in  the  scenario  which 
provide  a critical  point  and  best  time  for  evaluation  of  the  MOE  w’ll  be 
Identified.  These  situations  may  vary  in  time  for  the  same  MOE  if  the  dif- 
ferent echelons  have  their  critical  events  (or  busy  hours)  at  different  times. 
Some  MOEs  will  be  evaluated  by  the  S1MCE  or  CASE  models,  taking  scenario  com- 
munications requirements  and  resultant  equipment  deployments  as  input. 

Additionally,  several  MOEs  are  based  on  outputs  provided  by  the 
electromagnetic  compatibility/electromagnetic  vulnerability  (EMC/EMV) 
analysis  conducted  by  the  Electromagnetic  Environmental  Test  Facility  (F.METF) 
of  the  U.S.  Army  Electronic  Proving  Ground  (USAEPG).  The  analysis  will  be 
run  on  an  Army-developed  test  bed  that  is  based  on  a mid-intensity  combat 
scenario  wth  appropriate  friendly  and  enemy  force  models  used  in  conjunc- 
tion with  statistical  terrain  propagation  characteristics. 

2.6.2  Effectiveness  Utility  Method 

The  purpose  of  this  section  is  to  explain  the  development  of  effec- 
tiveness utility  methods  and  to  illustrate  their  u~e  in  conjunction  with 
measures  of  effectiveness  in  determining  an  overall  figure  of  merit  for  a 
given  system  alternative.  This  section  endeavors  to  answer  the  following 
questions: 


° How  are  utility  values  determined? 

0 How  will  utility  values  be  used? 

The  importance  of  tr.ase  two  steps  should  not  be  overlooked.  Escab- 
lishment  of  a coherent  relationship  between  utility  values  and  measures  of 
effectiveness  to  achieve  credible  figures  of  merit  will  significantly  im- 
pact the  effort  to  identify  the  preferred  system. 


In  a theoretical  sense,  utility  is  a dimensionless  number  assigned 
to  each  system  alternative  indicating  its  relative  effectiveness  with 
respect  to  particular  measures  of  effectiveness.  The  concept  of  utility 
serves  two  purposes;  first,  it  reduces  quantitative  and  qualitative  assess- 
ments of  different  dimensions  to  a single  dimensionless  quantity,  which 
is  used  as  a figure  of  merit.  Secondly,  it  provides  a vehicle  for  indi- 
cating actual  effectiveness  differences  that  result  from  differences  in 
quantitative  assessment  of  system  parameters.  The  FOM,  as  a representa- 
tion of  system  effectiveness  in  terms  of  a single  number,  facilitates 
cost/effectiveness  tradeoff  analysis  and  comparison  of  a large  number  of 
unrelated  pieces  of  information  on  each  alternative.  The  FOM  is  not 
intended  to  be  the  final  result  of  effectiveness  analysis,  but  only  one 
of  the  outputs.  Sensitivity  analysis  and  identification  of  the  driving 
forces  behind  FOM  results  are  also  important  considerations. 


If  the  methodology  for  combining  diverse  measures  into  a single  FOM 
is  to  be  successful,  it  should  satisfy  certain  requirements.  These  are 
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determined  by  the  nature  and  ultimate  use  of  the  desired 
case  of  INTArq,  the  requirements  are  as  follows: 


output. 


In  the 


Dimensionless  units  should  be  of  uniform  value; 

The  source  of  FOM  differences  should  be  identifiable  (all 
effectiveness  analyses  will  be  listed); 

The  present  communications  system  should  be  used  as  a 
baseline  for  comparison  purposes  only; 

Conversion  to  utility  should  be  done  during  the  evaluation 
< each  system,  so  that  transformations  necessary  to 
achieve  linearity  can  be  made; 

The  methodology  should  be  understandable  to  the  group 
making  value  judgements; 

Implementation  should  be  achievable  within  the  INTACS 
schedule. 


In  addition,  constraints  imposed  by  the  magnitude  and  depth  of  INTACS  are 

° Some  inputs  will  be  subjective; 

° Some  inputs  will  be  qualitative; 

A value  judgement  of  all  MOEs  at  one  time  is  impractical. 


hvhr.  , After  \ re^ieW  °f  pliable  reference  material  and  previous  work,  a 

Sized  aThisamei-hhHt1Sati8fie!/11  requirements  and  constraints  was  synthe- 
or  system^u till tv°^f nr PrOVJde8  an  acceptable  means  of  obtaining  an  FOM, 
or  system  utility,  for  each  alternative.  The  steps  to  be  completed  in 
generating  an  FOM  are:  completed  in 


Allocation  of  utility 
o Evaluation  of  each  alternative 
Calculation  of  FOM. 

These  steps  are  explained  in  the  subsections  that  follow. 
2. 6. 2.1  Utility  Allocation 


. . . 1116  all°cati°n  process  is  a method  by  which  the  total  utility  is 

tion  to  31110118  *he  yarious  M0Es  in  accordance  with  their  relative  contribu- 
the  auoca^n  ar"0"3  Sy8te"  elle^neSs.  steps  required  to  collet. 


# Designate  numerical  value  of  total  utility 

# Allocate  total  utility  to  areas 

, Allocate  each  area  utility  to  its  aspects 
Allocate  each  aspect  utility  to  its  MOEs. 
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Initially,  an  appropriate  number  of  utility  units,  or  utiles,  must 
be  designated  for  cti e total  utility.  This  is  an  arbitrary  number  selected 
by  the  analyst  to  provide  a ronvenient  degree  of  resolution. 

To  limit  the  number  of  elements  that  must  be  considered  at  one 
time,  distribution  of  total  utility  is  separated  into  three  stages.  The 
first  stage  is  to  distribute  the  total  utility  among  the  areas  of  effec- 
tiveness (AOEs) . The  basis  for  allocation  is  the  relative  importance  of 
each  communications  system  factor  under  consideration.  After  the  initial 
allocation  by  group  concensus,  a thorough  review  of  all  the  relative 
values  may  dictate  further  modification.  Of  the  utmost  importance  is 
that  the  group  fully  understand  the  concept  of  utility  and  be  cognizant 
of  all  the  implications  contained  in  the  final  product.  At  this  point, 
each  AOE  will  have  an  assigned  utility,  and  the  sum  of  all  these  area 
utilities  will  be  equal  to  the  total  utility. 

In  the  second  stage,  each  area  utility  is  subdivided  into  aspect 
utilities  through  the  same  group  concensus  allocation  process.  Finally, 
in  the  third  stage,  the  MOE  utilities  are  derived  from  aspect  utilities  by 
using  a similar  methodology. 

This  procedure  permits  uniform  units  of  utility  to  be  maintained 
at  every  stage,  which  enables  direct  comparison  of  components  within  the 
network.  An  example  is  presented  in  Figure  2.6-1.  In  this  figure,  12. 
measures  occur  at  the  MOE  level,  allowing  a reasonable  choice  for  total 
utility  of  120  utiles.  A typical  allocation,  which  finds  seven  measures 
on  the  aspect  level,  is  shown  in  the  figure.  Those  areas  of  interest  are 
located  on  the  area  level,  immediately  below  total  utility.  Therefore,  in 
effect,  the  figure  depicts  12  MOEs  grouped  into  seven  aspects  that  are 
reduced  to  three  area  groups,  all  comprising  the  total. 

Since  the  utility  units  are  uniform  throughout,  the  relative  value 
may  be  determined  for  any  component.  For  example,  to  illustrate  this 
point,  note  that  the  MOE  at  block  2/ l/l  was  awarded  25  utiles,  and  is 
considered  more  important  than  the  entire  area  (block  1)  at  a higher 
level  with  only  20  utiles. 

The  actual  allocation  of  utility  has  been  performed  by  the  Army;  it 
was  based  upon  an  analysis  and  synthesis  of  results  from  the  allocations  of 
four  independent  teams  of  active  Army  officers.  The  results  are  provided  in 
Appendix  A.  These  results  will  be  analyzed  to  determine  whether  or  not  the  _ 

number  of  MOEs  may  be  reduced.  If  an  MOE  has  little  effect  on  the  figure 
of  merit,  it  is  a candidate  for  elimination.  An  example  of  this  approach  is 
presented  in  Appendix  F.  

2. 6. 2. 2 Evaluation  of  Alternatives 


Once  a utility  value  is  established  for  each  MOE,  the  communica- 
tions systems  under  consideration  will  be  rated.  The  methodology  will  con- 
sider one  MOE  at  a time,  and  will  evaluate  the  performance  of  each  system 
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with  respect  to  that  indicator.  The  present  system  will  be  adopted  as  a 
baseline  and  assigned  the  zero  value  of  MOE  utility.  Other  alternatives 
will  be  Judged  relative  to  this  standard,  and  will  be  awarded  appropriate 
utility  by  group  concensus.  As  an  example,  observe  the  problem  outlined 
in  Figure  2.6-2.  Consider  that  MOE  (time  to  complete  call)  is  allocated  4 
utileB*,  three  systems  (A,  B,  C)  are  to  be  evaluated;  and  System  A is  the 
present  system.  System  A would  be  given  a value  of  0 utiles.  Slightly  lower 
effectiveness  in  System  B would  be  rated  -1  utile,  whi±e  a significantly 
better  System  C would  be  awarded  the  maximum  of  4 utiles.  The  process 
continues  until  each  system  has  been  evaluated  with  respect  to  every  MOE. 

At  this  point,  the  procedure  is  not  affected  when  alternatives 
are  evaluated  relative'  to  the  qualitative  MOEs.  In  this  case,  the  answers 
to  questions  stated  in  the  MOE  description  will  form  a basis  for  compari- 
son, with  the  present  system  still  representative  of  a baseline  and  assigned 
a zero  utility.  An  example  of  the  evaluation  process  is  presented  in 
Appendix  E. 

2.6.2. 3 Determination  of  Figure  of  Merit 

The  FOM  for  each  system  is  calculated  by  a summation  of  its  per- 
formance on  all  MOEs,  as  shown  in  Table  2.6-1.  These  results  are  used  to 
rank  the  alternatives  on  an  effectiveness  basis.  The  table,  in  the  simple 
format  shown,  will  serve  as  a scoreboard  to  record  relative  FOMs  and  sub- 
sequent rankings . 

This  section  summarizes  the  procedural  aspects  that  describe  how 
the  measurement  tools  will  be  used  in  an  orderly  scaling  process  to  deter- 
mine relative  values  and  a system  prioritization  of  competing  alternatives. 
Other  utility  measurement  methods  are  available,  but  the  techniques  ex- 
plained in  this  section  were  considered  most  applicable  to  the  problem  at 
hand. 


2.7  SENSITIVITY  ANALYSIS 

In  general,  sensitivity  analysis  is  a means  of  considering  uncertainty. 
In  Task  V,  some  of  the  input  parameters  will  be  fairly  well-known,  while 
others  may  consist  of  the  "best  guess"  over  a wide  range  of  possible  values. 
The  results  of  the  analysis,  using  best  estimates,  may  point  out  certain 
key  assumptions  or  input  parameters  that  impact  highly  on  the  results.  Also, 
little  may  be  known  about  a set  of  inputs,  so  that  estimates  may  be  subject 
to  error.  In  addition,  the  subjective  judgement  required  for  qualitative 
MOEs  and  utility  allocation  may  contribute  to  a lack  of  precision.  These  are 
the  assumptions  and  inputs  that  will  be  subject  to  sensitivity  analysis.  An 
example  of  this  analysis  is  presented  in  Appendix  E. 
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MOE  UTILITY  - FOUR  UTILES 


System 

HOE 

(sec) 

Utility 

A (baseline) 

3 

0 

B 

4 

•1 

C 

1.1 

4 

-2 

UTILES 


FIGURE  2.6-2  NOE  Conversion  to  Utility 
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TABLE  2.6-1 

Figure  of  Merit  and  System  Ranking 


r 


2.7.1  Parameter  Sensitivity  Analysis 

Faraaeter  sensitivity  analysis  consists  of  changing  an  assumption  or 
input  parameter  by  a specified  amount  and  determining  the  effect  this  has 
on  the  FOM.  Each  sensitivity  analysis  will  consist  of  selecting  the  assump- 
tion or  parameter  to  be  varied,  determining  the  MOEs  affected  by  the  change, 
and  calculating  the  resultant  FOM.  A suggested  approach  is  to  vary  the  in- 
put parameter  by  5 percent  of  its  value  and  determine  the  percentage  change 
in  the  FOM.  The  parameter  that  produces  the  greatest  change  in  the  FOM  is 
the  most  sensitive. 

Sensitivity  analysis  will  aid  in  selecting  the  preferred  alternative 
by  providing  the  tradeoff  analysis  with  an  FOM  for  alternative  concepts 
under  different  sets  of  assumptions  and  estimates  of  input  parameters.  Sen- 
sitivity of  the  FOM  to  the  qualitative  MOEs  will  be  addressed.  Specific 
input  parameters  to  be  varied  include  the  following: 

° Number  of  nodes  in  the  area  system 
° Multichannel  routing  schemes  in  both  SIMCE  and  CASE 
e Hold  time  (message  length) 

° Busy -hour  traffic. 


2.7.2  Utility  Allocation  Sensitivity  Analysis 


The  purpose  of  this  analysis  is  to  determine  the  effect  of  a slightly 
different  utility  allocation  on  the  figure  of  merit  for  each  system.  To 
illustrate  the  importance  of  this  concept,  consider  the  evaluation  of  two 
alternatives  (Systems  A and  B)  outlined  in  Figures  2.7-1  and  2.7-2.  IVo 
MOEs  are  used;  System  A offers  significant  improvement  in  the  parameter 
assessed  by  MOE-1,  and  slight  improvement  with  respect  to  MOE-2.  For  Sys- 
tem B,  the  data  is  slight  improvement  in  MOE-1  and  significant  improvement 
in  MOE-2.  Assume  that  10  utiles  are  allotted;  an  initial  allocation  of  8 
utiles  for  MOE-1  and  2 for  MOE-2  is  made.  After  the  evaluation  shown  in 
Figure  2.7-1,  System  A would  be  the  preferred  alternative,  with  9 utiles, 
compared  to  6 utiles  for  System  B.  If  a second  allocation  is  made  with 
MOE-1  reduced  to  4 utiles  and  MOE-2  increased  to  6 utiles,  the  ranking  is 
changed  as  shown  in  Figure  2.7-2.  System  B is  highest,  with  8 utiles, 
compared  to  7 utiles  for  System  A,  thus  reversing  the  previous  ranking. 


Obviously,  the  allocation  process  is  not  exact.  An  MOE  could  vary 
in  utility  if  a different  group  made  the  allocation,  or  even  if  the  same 
group  repeated  the  process  on  a different  occasion.  It  is  important  to 
determine  whether  or  not  a change  in  the  allocation  could  affect  the  rank- 
ing, and  this  is  the  purpose  of  utility  sensitivity  analysis. 


One  part  of  the  sensitivity  analysis  is  to  vary  each  MOE  utility  a 
fixed  percentage  and  examine  the  effect  on  ranking.  This  will  be  done  for 
each  system  to  see  if  the  ranking  changes  under  the  most  adverse  combina- 
tion of  variations.  A second  task  is  to  establish,  for  each  system,  an 
allocation  that  allows  that  particular  system  to  rank  highest.  The  feasi- 
bility of  each  allocation  will  be  discussed  in  the  Task  V Final  Report. 
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FIGURE  2.7-1  Initial  Allocation 
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MOE-1  MOE-2 


M°E-1  MOE-2 
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fIGURE  2.7-2  Second  Allocation 
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2'8  CO^EFFECTIVLNESS  TRADEOFF  ANALYSIS  AND  RANK-ORDERING  METHODOLOGY 

The,f1inf1  P*1396  °f  the  aPPi  Nation  of  the  eost/ef fectiveness  metho- 
dology will  be  the  development  of  a tradeoff  procedure  oriented  toward 
the  selection  of  a preferred  alternative.  The  results  of  the  cost  effec- 

BrigadeSwin8h’  and  sensitivity  analyses  for  EAD,  Division,  and  Separate 
Brigade  wi  1.1  be  used  to  select  the  preferred  alternative  at  each  echelon 
The  methodology  will  be  applied  as  follows: 


Develop  a tradeoff  analysis  summary  table 

Identify  the  dominated  alternatives 

Identify  alternatives  that  exceed  cost  thresholds 

Identify  high-risk  alternatives 

Perform  cost/effectiveness  sensitivity  analysis 

Select  and  refine  the  preferred  alternative. 

Each  of  the  above  steps  will  be  discussed  In  the  remainder  of  this  section 


2.8.1  Development  of  Tradeoff  Analysis  Summary  Table 

The  first  step  in  the  tradeoff  methodology  will  be  to  arranee  t-ho 
results  of  costs,  effectiveness  r40b  i ..  arrange  the 

Jn  T„L i _ o o 1 * . ecciveness*  and  risk  into  a summary  table,  as  shown 

2'8*2  Verification  of  Dominated  Alternatives 

fives  clearly  dominated  ^“erlueTaM  “ ^ ‘°  lde"“fp  tb*  al«tna- 
rlsk.  Entries  In  ?able  V , , ^ ^ cost'  ,f,K,1«.  »„d 

cos ts  and  lover  effectiveness  b exa"lned'  and  alternatives  with  higher 

titled.  These  attern“^s  vluTeC„°?»rinf  altematl''“  ^ »e  iden- 

ellminated  from  contention  for  the  oltf * 1"  f Broup  wlth  others  that  are 
complete  analysis  of  these  systems  £111^1  but  a 

A difficult  decision  may  be  thlTssJble  sesre^tf  V ? TaSk  V report- 

thrisd^^Uo„boyc°thCr  ba‘  contain 

considerably  greater 'costa  and's^mlff  Sh°“ld.be  eliminated  only  If  It  has 
alternatives.  significantly  less  effectiveness  than  other 


An  alternative  should  not  be  eliminated  if  it  han  m,.  f 1 1 4 

characteristics  relative  to  the  other  alternatives!  following 


* Slightly  greater  cost 
0 Slightly  less  effectiveness 
Lower  risk. . 
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Alternatives  with  these  characteristics  will  be  examined  in  the  sensitivitv 
phase  of  the  tradeoff. 
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2.8.3  Identification  of  Alternatives  that  Exceed  Cost  Thresholds 

The  third  step  will  be  to  identify  alternatives  wherein  cost  dif- 
ferences are  so  significant  as  to  indicate  that  the  alternative  will,  in 
all  likelihood,  exceed  cost  thresholds  provided  by  the  Army.  This  step 
will  require  consideration  of  expected  acceptable  costs  for  particular 
equipments.  Significant  cost  differences  between  alternatives  will  accrue 
from  the  approaches  adopted  for  phase-' n/phase-out  stages,  the  number  of 
equipments,  and  the  resources  for  new  developments. 

2.8.4  Identification  of  High-Risk  Alternatives 

The  fourth  step  in  the  tradeoff  methodology  will  be  to  identify  those 
alternatives  characterized  by  high  risk  along  with  a low  compensating  dif- 
ferential in  cost  and  effectiveness  as  compared  to  the  other  alternatives. 
Those  alternatives  with  high  risks,  costs  below  threshold,  and  relatively 
high  effectiveness  will  be  considered  as  candidates  in  the  selection  of  the 
preferred  alternative.  Alternatives  separated  by  this  step  will  most  likely 
consist  of  equipment  that  will  require  development  programs  but  not  eventu- 
ally contribute  to  a decrease  in  per-unit  cost  or  a substantial  increase  in 
effectiveness . 

2 . 8 . 5 Performance  of  Cost/Ef fectiveness  Sensitivity  Analysis 

The  fifth  step  of  the  tradeoff  methodology  provides  the  basis  for 
selecting  the  preferred  alternative  from  the  remaining  set.  The  cost, 
effectiveness,  and  risk  of  the  alternatives  will  be  expressed  as  a percen- 
tage of  the  least  cost  alternatives.  These  numbers  will  indicate  the  per- 
centage increase/decrease  in  effectiveness  obtained  for  the  percentage 
increase  in  cost.  Ire  percentage  change  in  risk  will  also  be  noted. 

2.8.6  Sr  lection  and  Refinement  of  the  Preferred  Alternative 

Final  selection  of  a preferred  alternative  over  those  remaining  will 
be  based  on  Step  5 of  the  methodology  and  a consideration  of  Table  2.8-1. 

The  results  of  Step  5 wil]  be  the  primary  consideration,  although  an  exami- 
nation of  Table  2.8-1  will  also  be  necessary,  since  some  special  attributes 
of  the  alternatives  might  not  be  reflected  in  the  analysis. 

After  the  preferred  alternative  is  selected,  it  will  be  refined  to 
obtain  the  optimal  system.  Weak  areas  of  the  system  will  be  identified 
and  improved  if  possible.  The  process  may  involve  combining  parts  of  an 
alternative  system  with  the  preferred  system  to  attain  the  best  performance. 
Once  the  alterations  are  complete,  the  evaluation  process  will  be  repeated 
to  validate  the  changes. 


i 


42 


A summary  paper  will  be  developed  to  document  the  analysis  and  the 
rationale  behind  the  selection  of  the  preferred  alternative.  It  will  con- 
tain the  following  sections: 

Summary  description  of  the  alternatives; 

* Results  01  the  analysis  as  presented  in  Table  2.8-1; 

Summary  of  the  method  by  which  Table  2.8-1  entries  were 
determined; 

Audit  trails  of  subjective  judgement  in  effectiveness 
evaluation ; 

Rationale  to  explain  the  selection  of  the  preferred 
alternative. 

This  supporting  paper  will  document  the  tradeoff  methodology. 


\ 
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APPENDIX  A 

EFFECTIVENESS  AREAS,  ASPECTS,  AND  MEASURES 


1.0  INTRODUCTION 


This  appendix  details  the  *reas,  aspects,  and  measures  of  system 
effectiveness  that  were  previously  outlined  in  Section  2.6.  The  utility 
allocation  for  these  MOEs  is  provided  in  Section  3.0  of  this  appendix. 

The  areas  of  effectiveness  are  broad  categories  of  system  capability 
relevant  to  the  MRTF  concepts  that  are  to  be  evaluated  and  to  the  opera- 
tional situations  in  which  these  concepts  are  to  be  evaluated.  One  or  more 
aspects  are  identified  and  defined  within  each  area  of  effectiveness.  These 
aspects  were  selected  on  the  basis  that  they  are  important  facets  of  the 
area  and  are  expected  to  distinguish  the  concepts  at  the  system  or  echelon 
level. 


Quantitative  and  qualitative  measures  of  effectiveness  are  defined 
for  each  aspect.  Procedures  for  evaluation  or  estimation  of  the  measures 
are  outlined,  including  identification  of  any  assumptions  made.  Any  require- 
ment for  Government-furnished  information  is  also  identified. 

The  term  "communications  analyst",  as  used  in  this  appendix,  refers 
to  the  members  of  the  Martin  Marie tta/Booz  Allen  study  team.  TVo  types  of 
individuals  are  covered  by  this  designation: 

° Retired  Army  signal  officers  who  are  crrrently  employed  by 
Martin  Marietta  or  Booz  Allen  and  who  have  been  assigned  fo 
the  INTACS  study  team; 

° Operations  research  analysts  employed  by  Martin  Marietta  or 
Bcoz  Allen  and  assigned  to  the  INTACS  effort. 

These  individuals  will  apply  the  subjective  considerations  required  to  make 
the  qualitative  evaluations  called  for  in  the  methodology. 
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2-°  AREAS , ASPECTS.  AND  MEASURES  OF  EFFECTIVENESS 


The  presentation  technique  will  be  the  same  for  each  of  the  14  areas 
and  will  contain  subparagraphs  in  a standard  ordering,  as  follows: 

Area  of  effectiveness 

Aspect  of  effectiveness  (within  the  area) 

Quantitative  measure  of  effectiveness  (within  the  aspect) 

Estimation  procedures  for  the  quantitative  MOEs  and  for  the 
qualitative  MOE,  if  applicable 

Assumptions  made  and  sources  of  information. 


2.1  AREA:  QUALITY  OF  SERVICE 

Quality  of  service  is  defined  as  the  ability  of  a communications  system 
to  effect  successful  first-try  call  initiation  in  a timely  manner  ard  with 
intelligible  message  transmission.  Quality  of  service  includes  the  follow- 
ing three  aspects: 

° Grade  of  service 
° Speed  of  service 
0 Information  quality. 


2.1.1  Aspect:  Grade  of  Service 

The  grade  of  service  (GOS)  is  defined  as  the  probability  that  a given 
transmission  will  not  be  blocked  at  some  point  in  the  path  between  the  trans- 
mitting user  and  the  receiving  user. 

2.1. 1.1  Quantitative  Measure  of  Effectiveness 

The  grade-of-service  MOE  is  defined  as  the  probability  that  a sub- 
scriber s call  attempt  will  not  be  blocked. 

2. 1.1. 2 Estimation  Procedures 

TTY  If  "radei0fi-^e  is  determined  separately  for  voice,  data,  fax,  and 
TY.  It  is  calculated  for  each  link,  and  the  measure  is  weighted  by  the 


A- 4 


volume  of  traffic  on  each  link.  The  GOS  for  a particular  communications 
mode  is  computed  as  follows: 


GOS  - ~ — Ze.  GOS. 

T‘i  1 1 1 

where 

= total  traffic  on  the  iC^  link 

GOS^  = grade  of  service  for  the  i^1  link. 

GOS^  is  determined  by  CASE  for  TP  and  TTY,  and  by  SIMCE  for  data 
and  net  radio.  GOS^  for  MARTS  is  computed  by  using  a special  queueing 
algorithm  to  represent  the  multiple  channels  available  to  the  user. 

2 . 1 . 1 . 3 Assumptions  and  Estimation  Conditions 

The  following  assumptions  and  estimation  conditions  are  made: 

0 The  call  attempt  is  made  during  busy-hour  traffic; 

° A .1  equipment  is  operational. 

2.1.2  Aspect:  Speed  of  Service 

Speed  of  service  (SOS)  is  the  total  delay  time  from  the  moment  the 
message  enters  the  system  until  the  receiving  unit  begins  to  receive  the 
message. 


2 . 1 . 2 . 1 Quantitative  Measure  of  Effectiveness 


The  speed-of-service  MOE  is  defined  as  the  probability  that  the 
total  delay  time  of  a message  is  within  the  acceptable  limits  for  messages 
of  that  precedence. 

2. 1.2. 2 Estimation  Procedures 


For  each  message  transmitted,  totals  will  be  accumulated  to 
reflect  transmission  time,  time  in  queue,  and  total  processing  time. 

From  this  information,  message  delay  time  will  be  calculated  (excluding 
actual  message  transmission  time).  For  each  mode  (except  TTY),  speed 
of  service  will  be  calculated  as  the  average  message  delay  time. 

Four  precedences  are  handled  by  the  CASE  model  for  TTY:  flash, 
immediate,  priority,  and  routine.  Message  delay  will  be  compared  with  JCS 
standards  for  each  precedence.  Statistics  will  be  accumulated  for  each 
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precedence,  to  Indicate  the  percent. ig«'  of  messages  that  have  a total  delay 
within  the  acceptable  limits.  These  four  percentages  will  be  averaged  to 
give  one  value  for  spepd  of  service  for  TTY. 

2 . 1 . 2 . 3 Assumptions  and  Estimation  Conditions 

The  following  assumptions  and  estimation  conditions  are  made. 

0 The  call  attempt  is  made  during  busy-hour  traffic; 

0 All  equipment  is  operational. 

2.1.3  Aspect:  Information  Quality 

The  degree  to  which  a candidate  concept  successfully  passes  messages 
that  meet  minimum  signal-to-noise  criteria  for  the  mode  of  transmission 
used  is  indicated  by  the  F.MC/EMV  communicability  scores.  For  example,  in 
the  communicability  subtest,  the  differing  RF  S/N  ratio  and  signal  strength 
requirements  for  an  HF  receiver  to  provide  adequate  speech  intelligibility 
(when  used  on  single  sideband  circuit)  or  text  intelligibility  (as  when 
used  on  teletype  circuits)  are  taken  into  account  by  specifying  different 
minimum  signal  requirements  when  used  In  different  modes.  In  the  communi- 
cability subtest,  the  probabilities  of  satisfactory  operation  (P(SO) ) are 
evaluated  for  links  between  friendly  transmitters  and  their  intended  re- 
ceivers without  considering  Interference.  The  EMC/EMV  analysis  combines 
these  P (SO)  into  system  effectiveness  (SE)  scores  for  net  types. 

2.1. 3.1  Quantitative  Measure  of  Effectiveness 
System  communicability  score. 

2. 1.3.2  Estimation  Procedures 

The  EMC/EMV  communicability  output  consists  of  a list  of  SE  scores 
by  net  type.  The  MOE  is  a weighted  arithmetical  mean  of  the  SE  scores  on 
the  basis  of  the  number  of  nets  of  the  net  type  and  a weighted  value  for  the 
net  type  determined  by  communications  analysts*: 


T 

E VL  Nc  (SE) 

CS  = <°  < S * 100> 

I Vt  Nt 
t-i 

where 

Cs  = the  system  communicability  score 
T * number  of  different  discrete  types 


* Where  applicable,  these  will  be  taken  from  DACE-CMS-E  letter  of  27  December 
1973,  Subject:  Standards  for  Weighting  Communications  and  Electronics  Nets 
and  Links  in  Simulated  Force  Models. 
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a discrete  net  type,  t=l,  2,  3,  4, 
value  of  net  t (0<  Vt  < 10) 


Nt  = number  of  nets  of  net  types  t in  the  system, 

Nt  = 1,  2,  3,  4,  ... 

(SE)t  = communicability  system  effectiveness  score  for 
net  type  t. 


2 . 1 . 3 , 3 Assumptions  and  Estimation  Conditions 

The  following  assumptions  and  estimation  conditions  are  made: 

° No  jamming  or  unintentional  interference  is  present  in 
the  communicability  subtest; 

° The  predominant  factors  that  affect  satisfactory  recep- 
tion of  signals  are  effective  radiated  power,  path  atten- 
uation, and  receiver  sensitivity; 

° Cumulative  noise  in  multilink  transitions  and  signal  con- 
ditioning, pulse  shape  restoration,  etc.,  are  not  considered. 


2.2  AREA-  MOBILITY 


Mobility  is  defined  as  the  capability  of  the  system  to  permit  users  to 
move  from  place  to  place  while  retaining  the  ability  to  fulfill  thei-  pri- 
mary mission.  It  includes  the  following  two  aspects: 

° Physical  setup/teardown  time 
° Ability  to  communicate  during  moves. 

2.2.1  Aspect:  Physical  Sctup/Teardown  Time 

The  concepts  will  be  evaluated  according  to  the  average  time  required 
to  sec  up  or  tear  down  critical  equipment  or  assemblages  of  equipment  under 
normal  system  conditions. 

2. 2. 1.1  Quantitative  Measure  of  Effectiveness 
Physical  setup/teardown  time. 

2. 2. 1.2  Estimation  Procedures 


Communications  analysts  will  identify  the  CE  equipment  that  is  con- 
sidered critical  to  system  performance  and  that  differs  among  the  concepts. 
Additionally,  major  assemblages  of  equipment  (e.g.,  radio  terminal  set, 
command  center,  operations  center)  will  be  specified  and  evaluated. 
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From  setup/teardown  procedures  for  the  individual  equipment,  re- 
quired man-minutes  (by  MOS,  if  appropriate)  will  be  estimated  by  communi- 
cations analysts. 

■ 

The  critical  path  for  setup/teardown  time  for  both  critical  equip- 
ment and  major  assemblages  of  equipment  will  be  determined  by  considering 
the  required  sequence  of  events  in  setup/teardown  procedures  and  the  man- 
power restrictions  (e.g.,  same  individual  responsible  for  several  pieces  of 
equipment).  The  time  along  this  critical  path  is  the  actual  measure  of 
setup/teardown  time. 

2.2.1. 3 Assumptions  and  Estimation  Conditions 

For  equipment  in  the  current  inventory,  setup/teardown  procedures 
will  be  determined  from  technical  manuals. 

Communications  analysts  will  estimate  setup/teardown  times  for 
equipment  in  R&D  based  on  the  setup/teardown  times  of  similar  equipment  in 
the  current  inventory. 

2.2.2  Aspect:  Ability  to  Communicate  During  Moves 

The  concepts  will  be  evaluated  according  to  the  reduced  capability  and 
information  intelligibility  degradation  for  a unit  during  movement.  Units 
considered  will  be  of  company  size  or  larger. 

2 . 2 . 2 . 1 Quantitative  Measure  of  Effectiveness 

Reduced  communications  capability  for  unit  during  move. 

2. 2. 2. 2 Estimation  Procedures 

Communications  analysts  will  identify  situations  in  the  scenario 
that  dictate  the  movement  of  a unit.  For  the  members  of  that  unit,  total 
communications  capability  (channels/nets  available)  prior  to  movement  will 
be  noted  and  compared  to  the  reduced  capability  during  movement.  The  ~ 

average  percent  reduction  in  capability  will  be  the  quantitative  MOE.  In 
addition,  communications  analysts  will  estimate  the  degradation  of  informa- 
tion intelligibility  that  results  from  small  sector  signal  variation.  This 
will  be  in  the  form  of  a qualitative  MOE. 

2 . 2 . 2 . 3 Assumptions  and  Estimation  Conditions 

Impact  of  a unit  move  on  the  entire  network  will  be  considered  in 
a separate  MOE. 
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2 . 3 AREA:  TRANSPORTABILITY 

Transportability  is  defined  as  the  capability  to  efficiently  and  effec- 
tively transport  a communications  equipment  complex.  Transportability 
includes  the  following  aspects: 

Size  and  weight  of  CE  equipment,  support  parts,  and  power 
sources ; 

Vehicle  requirements  of  the  communications  system; 

° Portability. 

Aspect:  Size  and  Weight  of  CE  Equipment,  Support  Parts,  and 
Power  Sources 

The  concepts  will  be  evaluated  according  to  the  total  volume  and 
weight  of  the  equipment  and  power  and  support  parts  required  for  each  sub- 
system (TROPO,  LOS,  etc.)  and  for  the  entire  communications  system. 

2.3. 1.1  Quantitative  Measure  of  Effectiveness 

Total  volume  (in  cubic  feet)  of  communications  system/subsystem 
equipment  and  parts,  and  total  weight  (in  tons)  of  communications  system/ 
subsystem  equipment  and  parts. 

2. 3. 1.2  Estimation  Procedures 

The  system  design  effort  in  Task  V will  provide  TOEs  for  all  units. 
From  these  TOEs,  CE  equipment  quantities  and  types  will  be  obtained.  Sup- 
port parts  and  power  requirements  (generators,  batteries,  etc.)  will  be 
identified,  as  indicated  in  Subsections  2.8.1  and  2.8.2.  Communications 
analysts  will  categorize  the  equipment,  parts,  and  power  sources  according 
to  the  subsystems  they  support.  The  total  volume  and  weight  for  each  of 
these  subsystems  and  for  the  entire  system  will  then  be  calculated. 

2 . 3. 1 . 3 Assumptions  and  Estimation  Conditions 

The  volume  and  weight  for  specific  equipment,  parts,  and  power 
sources  in  the  current  inventory  will  be  GFI.  This  information  will  be 
estimated  by  communications  analysts  for  any  item  in  R&D. 


2*3*2  Aspect:  Vehicle  Requirements  of  the  Communications  System 

The  concepts  will  be  evaluated  according  to  the  total  number  and 
type  of  transport  vehicles  required  to  support  the  communications  system. 
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2 . 3 , 2 . 1  Quant itative  Measure  of  Effectiveness 

Percentage  of  total  transport  vehicles  (required  to  provide  com- 
munications support  to  the  unit)  that  are  organic  to  the  unit. 


2 . 3 . 2 . 2  Estimation  Procedures 

The  system  design  effort  in  Task  V will  provide  TOEs  for  all  units. 
These  TOEs  indicate  the  equipment  and  vehicles  that  are  organic  to  the  in- 
dividual units.  Based  on  volume,  weight,  time,  and  other  considerations, 
communications  analysts  will  identify  the  vehicle  requirements 
to  transport  the  specific  CE  equipment  used  by  that  unit.  These  vehicl 
will  be  categorized  by  type  (e.g.,  1/4- ton  and  2 1/2-ton  trucks,  vans,  n 
trailers)  and  will  be  totaled  to  provide  the  vehicle  requirements  of  e 
unit.  For  each  type,  the  percentage  of  required  vehicles  that  are  organic 
to  the  unit  will  be  calculated.  (For  the  system,  the  Pontage  of  total 
vehicle  requirements  organic  to  the  unit  will  be  calculated.)  g 

this  percentage,  the  better  the  value  of  the  MOE. 

2. 3.2. 3  Assumptions  and  Estimation  Conditions 

Vehicles  not  used  to  transport  communications  equipment  or  power 
sources  will  be  excluded  when  identifying  vehicles  organic  to  the  unit. 


2.3.3  Aspect:  Portability  of  CE  Equipment 

The  concepts  will  be  evaluated  according  to  the  degree  of  portability 
of  CE  equipment.  Portability  is  determined  by  equipment  characteristics 

and  function. 

2 . 3. 3. 1 Quantitative  Measure  of  Effectiveness. 


Not  applicable. 


2. 3. 3.2  Estimation  Procedures 

The  system  design  effort  in  Task  V will  provide  TOEs  for  each  unit 
within  an  echelon.  These  TOEs  indicate  quantities  of  types  of  equipment 
required  for  each  alternative.  After  examining  size,  weight,  function, 
power  source  requirements,  and  other  features  of  each  type  of  equipment, 
communications  analysts  will  assign  the  CE  equipment  to  one  or  more  of  the 
following  nine  categories: 


° Equipment  designed  for  permanent  installation; 

° Equipment  capable  of  being  used  in  two  or  more  types  of 
ground  installations; 

° Compact,  lightweight  equipment  that  may  be  held  by  one 
hand,  suspended  from  a belt,  or  carried  in  a pocket  and 
operated  on  the  move; 
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Compact,  lightweight  equipment  to  attach  to  a helmet  or  to 
headgear  of  some  tvpe,  and  for  operation  by  the  bearer; 


r 

h 


l 


0 Equipment  installed  and  operated  from  a vehicle  whose  sole 
function  is  to  house  and  transport  the  equipment  (the 
vehicle(s)  must  be  "part  of"  the  equipment); 

° Equipment  designed  to  be  transported  by  one  man  and  not  to 
be  operated  on  the  move; 

0 Equipment  designed  for  packing  into  individual  manloads 
for  transport  by  a team  (not  operated  while  in  transport); 

0 Equipment  larger  than  handheld  but  designed  for  operation 
while  being  carried  by  one  man; 

° Equipment  installed  in  a vehicle  designed  for  functions 
other  than  carrying  electronic  equipment,  such  as  tanks, 
weapons  carriers,  etc.  The  equipment  must  be  capable  of 
operation  while  the  vehicle  is  in  motion. 

After  completion  of  this  categorization,  communications  analysts 
will  evaluate  portability  for  the  communications  system  as  a qualitative  MOE. 

2. 3. 3. 3 Assumptions  and  Estimation  Conditions 

For  equipment  in  the  current  inventory,  all  pertinent  features 
necessary  for  this  evaluation  can  be  obtained  from  technical  manuals.  For 
equipment  currently  in  R&D,  this  information  will  be  provided  by  the  system 
designers . 

2 . 4 AREA:  VULNERABILITY 

Vulnerability  is  defined  as  those  characteristics  of  a system  that  cause 
it  to  suffer  definite  degradation  (incapability  to  perform  the  designated 
mission)  as  a result  of  having  been  subjected  to  a certain  level  of  effects 
in  an  unnatural  (manmade)  hostile  environment.  Specific  factors  in  vulnera- 
bility are  susceptibility  due  to  inherent  hardware  weaknesses,  enemy  threat, 
and  interceptibility.  Vulnerability  includes  the  following  aspects: 

0 Susceptibility  to  physical  destruction  (ground/air) 

0 Susceptibility  to  direction-finding 
0 Interceptibility. 

2.4.1  Aspect:  Susceptibility  to  Physical  Destruction 

The  concepts  will  be  evaluated  according  to  the  likelihood  that  an 
enemy  can  successfully  execute  destructive  physical  attack  (ground/air)  on 
major  points  in  the  communications  system.  This  will  include  consideration 
of  inherent  hardware  weaknesses,  susceptibility  to  physical  or  electronic 
detection,  likelihood  of  enemy  attempt  to  attack,  and  capability  of  defense 
against  enemy  attack-  Entire  nodes,  selected  functions  at  a node,  and  power 
sources  will  be  analyzed  in  terms  of  susceptibility  to  physical  destruction. 

The  threat  to  be  used  will  be  the  INTACS  threat  as  furnished  by  the  Government. 


2.4. 1.1  Quj 


arive  Measure  of  Effectiveness 


i 

l 
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Weighted  geographic  distance  of  net  nodal  traffic  from  the  forward 
edge  of  the  battle  area  (FEBA). 

2. 4. 1.2  Estimation  Procedures 

The  following  steps  will  be  taken  to  calculate  the  MOE: 


0 After  the  concept  has  keen  sized  and  deployed  in  conjunc- 
tion with  user  requirements  data,  the  busy-hour  traffic  at 
each  node  is  segregated  into  m (m  = 1,  2,  3,  ...  M)  cate- 
gories by  message  type  and  precedence. 

° Each  category  m is  then  assigned  a weighting  factor  Wm 
(W_  =1,  2,  3,  ...  10)  by  communications  analysts  (i.e., 
a flash  operational  message  may  have  a value  of  10,  while 
a routine  administrative  message  has  a value  of  2). 


° Each  node  of  a network  is  identified  by  an  integer  j, 
where  j = l,  2,  3,  ...  N. 


0 Node  by  node,  the  busy-hour  traffic  is  segregated  into  the 
m categories  to  give  a message  count  for  node  j by  category 
m.  The  number  of  messages  of  the  mth  category  at  the  jth 
node  is  . 

° The  importance  of  the  jc^  node  is  taken  by  summing  the 
products  of  Nmj  by  the  corresponding  weighting  factors, 


I 


j 


M 
= Z 
m=l 


W 

m 


where 

Ij  = importance  of  the  j1"*1  node 

= number  of  messages  (busy-hour  traffic)  at 
the  node  of  category  m 


Wm  = weighting  factor  for  category  m 
messages. 

0 The  relative  importance  of  the  j1’'1  node  to  the  entire  sys- 
tem is  indicated  oy: 


The  distances  (in  kilometers)  of  the  j1"*1  nodes  from  the 
FEBA  (as  taken  from  the  scenario)  are  tabulated  as  D ^ . 

Weighted  distances  of  net  nodal  traffic  from  FEBA  (WDNTF) 
are  computed  using  the  following  equation: 


R 


WDNTF 


N 
£ 

j=l  D 


J 


J 


The  higher  the  WDNTF,  the  greater  the  vulnerability  of  the 
system  from  attack. 

In  addition,  answers  to  the  following  questions  will  be  used  to 
compare  the  concepts: 

Considering  known  enemy  detection  capabilities,  uniqueness, 
and  size  or  signature  of  critical  nodes  in  the  system,  dis- 
tance from  FEBA,  physical  size,  inherent  hardware  weak- 
nesses, and  degree  of  exposure  of  equipment  and  power 
sources,  what  is  the  likelihood  of  enemy  detection? 

8 In  situations  with  a well-defined  FEBA  (excluding  air- 
mobile operations  or  a tactical  nuclear  environment  that 
results  in  widely  dispersed  friendly  and  hostile  forces) 
and  considering  the  known  enemy  priorities  and  capabilities, 
importance  of  a node,  and  distance  from  FEBA,  what  is  the 
likelihood  of  an  enemy  attempt  to  destroy  the  node? 

0 Considering  distance  from  FEBA,  physical  protection  (for- 
tification), proximity  to  military  defense,  and  the  capa- 
bility of  the  equipment  to  withstand  damage,  what  is  the 
capability  of  averting  destruction  or  damage  to  a critical 
node  in  the  event  of  attack? 

8 How  does  mobility  affect  the  vulnerability  of  the  system? 

The  answers  to  these  questions  will  be  based  on  a qualitative 
evaluation  of  each  of  the  concepts  performed  by  communications  analysts. 

These  answers  will  be  in  the  form  of  a qualitative  MOE. 

2.4.1. 3 Assumptions  and  Estimation  Conditions 

The  significance  of  the  quantitative  MOE  is  based  on  the  assump- 
tion that  an  enemy  will  attack  any  system  element  he  can  locate,  provided: 

1)  he  is  not  gaining  useful  intelligence  from  passive  intercept  and  analy- 
sis; 2)  he  is  unable  to  take  advantage  of  manipulative  deception  techniques; 
or  3)  he  us  unable  to  successfully  jam  the  element.  It  is  further  assumed 
that  the  vulnerability  of  an  element  decreases  proportionally  to  the  square 
of  its  distance  from  the  enemy;  however,  this  measure  does  not  properly 
apply  to  the  use  of  satellites  as  nodes,  nor  to  situations  where  a well- 
defined  FEBA  does  not  exist. 
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Tn  -,11  cases  nodes  will  be  located  in  such  a manner  that  the 
effective  radius  of  the  enemy's  largest  conventional  weapon  could  not  damage 
or  destroy,  with  a single  hit,  more  than  one  node. 

2.4.2  Aspect:  Susceptibility  to  Direction- Finding 

The  degree  to  which  unit  positions  are  compromised  by  a candidate 
n.  ,R  indicated  by  the  EMC/EMV  direction-finding  scores  of  the  net 
ZT  in  ihe  dlrfcaon  tmdln*  subtest,  the  paths  between  friendly  trans^ 

frec- 

rir^rin^rurtrrnuiLnibti^AurdiHerent  minimum  received 
signal  criteria  are  used). 

2.4. 2.1  Quantitative  Measure  of  Effectiveness 

Weighted  average  of  EMC/EMV  analysis  direction-finding  subtest 

scores. 

2. 4. 2. 2 Estimation  Procedures 

The  EMC/EMV  analysis  direction- finding  output  consists  of  a series 
of  scores  by  net  type.  The  MOE  is  a weighted  arithmetic  mean  of  these 
scores  on  the  basis  of  the  number  of  nets  of  the  net  type  and  a weighted 
value  for  the  net  type  determined  by  communications  analysts  . 


WDF 


l Vt  Nt  (DF)t 

t*1  — (0<  WDF  .<100) 


T 

l 

t-1 


E Vt  Nt 


where 


WDF 

T 

t 

V. 


(DF) 


weighted  average  of  EMC/EMV  analysis  direction- 
finding  subtest  score 

number  of  different  discrete  net  types 

a discrete  net  type,  t-1,  2,  3,  4,  ...  T 

value  of  net  type  t (0  <Vfc<  10) 

. number  of  nets  of  net  type  t in  the  system, 

■ 1,  2,  3,  4,  .... 

■ direction-finding  subscore  for  net  type  t. 


. Where  applicable,  these  will  be  taken  from  DACE-CMS-E  letter  of  27  Decem- 
ber  1973\  Subject:  Staudarde  for  Weighting  Communications  and  Electronics 
Nets  and  Links  in  Simulated  Force  Models. 
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2.4.2. 3 Assumptions  and  Estimation  Conditions 
None. 

2.4.3  Aspect:  Interceptibility 

The  extent  to  which  an  enemy  can  monitor  traffic  and  message  flow 
in  a candidate  concept  is  indicated  by  the  EMC/EMV  intercept  subtest  score. 
The  interference  prediction  mode]  computes  compatibilities  over  paths  be- 
tween victim  transmitters  and  enemy  intercept  receivers.  The  lower  the 
interceptibility,  the  greater  the  transmission  security  of  the  candidate 
concept. 


2.4. 3.1  Quantitative  Measure  of  Effectiveness 

Weighted  average  of  EMC/EMV  analysis  intercept  subtest  scores. 

2.4. 3.2  Estimation  Procedures 

The  EMC/EMV  subtest  output  will  be  in  the  form  of  a series  of 
scores  by  net  type.  The  MOE  is  a weighted  arithmetical  mean  of  these  scores 
on  the  basis  of  the  number  of  nets  of  the  net  type  and  a vjeighted  value  for 
the  net  type  determined  by  communications  analysts*: 

T 

Z Vt  Nt  (IN)t 

(0<  WIN  <100) 

E Vt  Nt 
t-1 

= weighted  average  of  EMC/EMV  analysis  intercept 
subtest  scores 

= number  of  different  discrete  net  types 

* a discrete  net  type,  t=l,  2,  3,  4,  ...  T 

* value  of  net  type  t (0<V^5l0) 

= number  of  nets  of  net  type  t in  the  system,  Nt*l, 
2,  3,  4,  ... 

(IN)t  - intercept  score  for  net  type  t. 

2.4. 3. 3  Assumptions  and  Estimation  Conditions 

None. 


* Where  applicable,  these  will  be  taken  from  DACE— CMS— E letter  of  27  Decem- 
ber 1973,  Subject:  Standards  for  Weighting  Communications  and  Electronics 
Nets  and  Links  in  Simulated  Force  Models. 


where 


»»  * ii 


WIN 


T 

t 

V^ 


i 
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2.5  AREA:  SURVIVAB ILITY 


Survivability  is  defined  as  the  capability  of 
to  degrade  gracefully  in  mission  performance  after 
tive  physical  or  electronic  attack.  Survivability 
aspects : 


a communications  system 
having  suffered  destruc- 
includes  the  following 


° Impact  of  destruction  of  communications  system  nodes 
• Impact  of  jamming. 


2.5.1  Aspect:  Impact  of  Destruction  of  Communications  System  Nodes 

The  concepts  will  be  evaluated  according  to  their  ability  to  provide 
continuity  and  quality  of  service  after  the  total  or  partial  destruction 
of  one  or  more  nodes  in  the  system.  This  will  include  consideration  o 
backup  equipment,  alternate  routing,  alternate  transmission  moues,  alter- 
nate power  sources,  and  the  option  of  re-engineering  the  system.  E-itire 
nodes,  selected  functions  at  a node,  and  po;^er  sources  will  be  in 

terms  of  the  impact  of  their  destruction  on  the  system.  The  study  wil 
address  the  loss  of  subscribers,  recovery  time,  and  degradation  of  GOS  due 

to  such  destruction. 


2 . 5 . 1 . 1  Quantitative  Measure  of  Effectiveness 

0 Number  of  nodes  that  must  be  destroyed  before  GOS  is  reduced 
to  certain  specific  levels; 

° Subscriber  loss  resulting  from  nodal  destruction. 


2. 5. 1.2  Estimation  Procedures 

GOS  will  be  measured  by  SIMCE  at  the  system  busy  hour  in  the  sce- 
nario. Based  on  traffic  volume  at  the  busy  hour,  the  node  that  handles  the 
most  traffic  will  be  identified  and  considered  destroyed.  Subscriber  loss 
due  to  the  destroyed  node  will  be  estimated  by  communications  analysts. 

GOS  will  be  recomputed  by  SIMCE,  to  indicate  the  results  of  the  destruction 
of  the  node.  The  process  of  identifying  and  destroying  the  busiest  node 
and  then  measuring  the  impact  of  that  uestruction  is  reiterated  until,  in 
the  judgement  of  the  communications  analysts,  the  communications  system 
fails  to  provide  minimal  acceptable  service.  Specific  levels  of  degrada- 
tion (lu  terms  of  GOS)  will  be  highlighted  and  the  degree  of  destruction 
(number  of  nodes  destroyed)  resulting  in  this  degradation  will  be  indicated 

for  each  concept. 


* 


The  above  procedure  will  be  used  to  calculate  the  quantitative 
MOEs.  Additionally,  answers  to  the  following  questions  will  be  used  to 
compare  the  concepts: 

0 What  capability  exists  to  provide  backup  equipment  in 
response  to  total  or  partial  destruction  at  a node? 

• What  capability  exists  for  alternate  routing  in  response 
to  total  or  partial  destruction  at  a node? 

0 What  capability  exists  for  using  alternate  transmission 
modes  in  response  to  total  or  partial  destruction  at  a 

node? 


° What  capability  exists  for  using  alternate  power  sources 
in  response  to  destruction  of  primary  power  sources  of 
equipment  at  a node? 

# What  capability  exists  for  re-engineering  the  nodal  net- 
work in  response  to  total  or  partial  destruction  at  a 
node? 

° How  does  the  organizational  structure  of  TCCF  affect 

its  ability  to  coordinate  the  restoration  of  the  communi- 
cations system  after  total  or  partial  destruction  at  a 
node? 

# What  is  the  outage  time  due  to  total  or  partial  destruc- 
tion at  a node? 

The  answers  to  these  questions  will  be  subjective  and  based  on  a qualita- 
tive evaluation  of  each  of  the  concepts  performed  by  communications  analysts. 
These  answers  will  be  in  the  form  of  a qualitative  MOE. 

2.S.1.3  Assumptions  and  Estimation  Conditions 

In  a network  simulation  model,  satellites  will  be  considered  nodes 
that  might  be  destroyed;  the  impact  of  this  will  be  evaluated  by  the  esti- 
mation procedure  outlined  above. 

2.5.2  Aspect:  Impact  of  Jamming 

The  degree  to  which  enemy  jamming  disrupts  operation  of  a candidate 
concept  is  indicated  by  the  EMC/EMV  jamming  vulnerability  score.  The  basis 
of  the  score  is  the  reduction  in  compatibility  score  experienced  by  victim 
receiver (s)  (e.g.,  satellite,  net  radio,  MARTS,  etc.)  as  a result  of  enemy 
jamming.  This  reduction  in  compatibility  will  reflect  the  success  or  failure 
of  the  enemy  ECM  effort. 


I 


A- 17 


I 


2 . 5 . 2 . 1 Quant itatlve  M* isurc  of  effectiveness 

Weighted  average  of  EMC/EMV  analysis  jamming  vulnerability  sub- 
teat  scores. 

2.5. 2. 2 Estimation  Procedures 

The  EMC/EMV  analysis  jamming  vulnerability  output  consists  of  a 
series  of  scores  by  net  type.  The  MOE  is  a weighted  arithmetic  mean  of 
these  scores  on  the  basis  of  the  number  of  nets  of  the  net  type  and  a 
weighted  value  for  the  net  type  determined  by  communications  analysts*: 

T 

£ Vt  Nt  (JM)t 

WjM  = i — (0  <WJM  <100) 

* Vt  Nt 
t=l 

wiu  re 

v/.fM  = weighted  average  of  EMC/EMV  analysis  jamming 
vulnerability  subtest  score 

T - number  of  different  discrete  net  types 

t = a discrete  net  type,  t*l,  2,  3,  4,  ...  T 

Vc  * value  of  net  type  t (0 < Vfc  < 10) 

N = number  of  net  type  t in  the  system  (Nt  - 1,  2, 
3,4,  ...  ) 

(JM>c  * jamming  subscore  of  Put  type  t. 

2 . c, . 2 . 3 Asf  -motions  and  Estimation  Conditions 

The  jj.md.ng  modv  1 in  CASE  will  not  be  used. 


i 


2.6  AREA:  Fi.L-.fBl  . 

FlexioJ lJ.:.v  it  defined  as  the  capability  of  the  system  to  expand,  con- 
tract, ar.d/or  reorganise  to  satisfy  a variety  of  communications  requirements. 
Flexibility  includes  the  following  aspects: 

• Ability  to  func: ion  in  various  operational  environments 

0 Ability  to  adapt  to  changing  force  structure 

0 Ability  to  meet  the  commander's  change  in  mission 

* Where  applicable,  these  will  be  taken  from  DACE-CMS-E  letter  of  27  Decem- 
ber 1973,  Subject:  Standards  for  Weighting  Communications  and  Electronics 
Nets  and  Links  in  Simulated  Force  Models. 
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8 Ability  to  adapt  to  various  ratios  of  traffic  types 
8 Ability  to  add  subscribers 
8 System  modularity 
8 Downtime  due  to  CP  displacement 

8 Ability  to  operate  in  dispersed  or  concentrated  deployments 
8 Hardware  modularity. 

2.6.1  Aspect:  Ability  to  Function  in  Various  Operational  Environments 

The  concepts  will  be  evaluated  according  to  their  ability  to  function 
in  various  types  of  warfare  (specifically,  tactical  nuclear  and  tactical 
non-nuclear)  and  in  various  terrains.  This  ability  to  function  is  influ- 
enced by  vulnerability,  survivability,  maintainability,  logistical  support 
requirements,  mobility,  transportability,  RF  spectrum  requirements,  and 
quality  of  service. 

2.6. 1.1  Quantitative  Measure  of  Effectiveness 
Not  applicable. 

2.6. 1.2  Estimation  Procedures 


Answers  to  the  following  questions  form  the  basis  for  concept 
comparison: 

How  does  susceptibility  (to  weather,  ECM,  ground  or  air 
attack)  differ  in  vcrious  operational  environments? 

8 How  does  the  impact  of  electronic  jamming  or  physical 
destruction  differ  in  various  operational  environments? 

8 How  do  the  maintenance/logistical  requirements  (for  cor- 
rective maintenance,  software  updates,  and  power  require- 
ments) differ  in  various  operational  environments? 

8 How  does  mobility  (in  terms  of  setup/teardown  time  and  the 
ability  to  communicate  while  moving)  differ  in  various 
operational  environments? 

8 How  do  the  number  and  type  of  vehicles  required  to  support 
the  communications  system  differ  in  various  operational 
environments? 
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# How  do  the  RF  spectrum  requirements  differ  in  various 
operational  environments? 

° How  do  GOS  and  information  intelligibility  differ  in 
various  operational  environments? 

The  answers  to  these  questions  will  be  based  on  a qualitative  evaluation 
of  each  of  the  concepts  performed  by  communications  analysts.  These  ans- 
wers will  be  in  the  form  of  a qualitative  MOE. 

2. 6. 1.3  Assumptions  and  Estimation  Conditions 

The  concepts  will  not  be  compared  for  changes  in  security  due  to 
the  various  operational  environments. 

2.6.2  Aspect;  Ability  to  Adapt  to  Changing  Force  Structure 

The  concepts  will  be  evaluated  according  to  their  ability  to  accom- 
modate additional  units.  Specifically,  the  Brigade  will  be  examined  with 
an  additional  battalion;  the  Division  with  an  additional  brigade;  the  Corps 
with  an  additional  brigade  or  division;  and  the  Theater  Army  with  an  addi- 
tional division  or  corps,  or  with  such  special  forces  as  air  defense,  field 
artillery,  and  Army  Tactical  Data  Systems  (ARTADS).  The  ability  to  adapt  to 
changing  force  structure  will  be  influenced  by  maintenance/logistical 
requirements,  transportability,  RF  spectrum  requirements,  and  quality  of 
service. 

2.6.2. 1 Quantitative  Measure  of  Effectiveness 

Not  applicable. 

2.6.2. 2 Estimation  Procedures 

The  following  questions  form  the  basis  for  concept  comparison; 

0 How  do  the  requirements  for  software  updates  differ  when 
additional  units  are  deployed  in  the  force  structure? 

0 How  does  the  Increased  burden  of  meeting  power  require- 
ments (generators,  batteries,  etc.)  differ  when  additional 
units  are  deployed  in  the  force  structure? 

° How  does  the  Increased  burden  of  meeting  supply  and  trans- 
portation requirements  differ  when  additional  units  are 
deployed  in  the  force  structure? 

* How  do  RF  spectrum  requirements  (frequency  assignment  to 
minimize  friendly  interference)  differ  when  additional 
units  are  deployed  in  the  force  structure? 


0 How  does  the  quality  of  service  (in  terms  of  GOS  and  infor- 
mation intelligibility)  differ  when  additional  units  are 
deployed  in  the  force  structure? 

The  answers  to  these  questions  will  be  subjective  and  based  on  a qualita- 
tive analysis  of  each  of  the  concepts  performed  by  communications  analysts. 
These  answers  will  be  in  the  form  of  a qualitative  MQE. 

2.6.2. 3 Assumptions  and  Estimation  Conditions 

The  concepts  will  not  be  compared  for  changes  in  security  due  to 
changing  force  structure. 

2.6.3  Aspect:  Ability  to  Meet  Commander’s  Change  in  Mission 

The  concepts  will  be  evaluated  according  to  their  ability  to  satis- 
fy communications  requirements  imposed  by  a change  in  the  commander's  mis- 
sion from/to  each  of  the  following:  defense,  attack,  withdrawal,  or  rein- 
forcement. Specifically,  at  the  echelons  of  Brigade  and  Division,  the 
effects  of  a change  from  each  mission  to  each  of  the  other  three  missions 
will  be  examined.  The  ability  to  meet  the  commander's  change  in  mission 
will  be  influenced  by  vulnerability,  survivability,  maintainability,  logis- 
tical support  requirements,  mobility,  transportability,  RF  spectrum  require- 
ments, and  quality  of  service. 

2.6.3. 1 Quantitative  Measure  of  Effectiveness 
Not  applicable. 

2. 6. 3. 2 Estimation  Procedures 


Answers  to  the  following  questions  form  the  basis  for  concept 
comparison: 

• How  does  susceptibility  (to  weather,  ECM,  ground  or  air 
attack)  differ  with  the  mission? 

# How  does  the  impact  of  electronic  jamming  or  physical 
destruction  differ  with  the  mission? 

0 How  do  the  maintenance/logistical  requirements  (for  cor- 
rective maintenance,  software  updates,  and  power  require- 
ments) differ  with  the  mission? 

0 How  does  mobility  (in  terms  of  setup /teardown  time  and 
the  ability  to  communicate  while  moving)  differ  in  chang- 
ing from  one  mission  to  another? 
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How  do  the  number  and  type  of  vehicles  required  to  support 
the  communications  system  differ  with  the  mission? 

How  do  GOS  and  information  intelligibility  differ  with  a 
change  in  mission? 

The  answers  to  the  questions  will  be  subjective  and  based  on  a qualitative 
evaluation  of  each  of  the  concepts  performed  by  communications  analysts. 

These  answers  will  be  in  the  form  of  a qualitative  MOE. 

2. 6. 3. 3 Assumptions  and  Estimation  Conditions 

The  concepts  will  not  be  compared  for  changes  in  security  due  to  - 

the  commander  s change  in  mission. 


I 


2*6*4  Aspect:  Ability  to  Adapt  to  Various  Ratios  of  Traffic  Types 

The  concepts  will  be  evaluated  according  to  their  ability  to  handle 
changing  ratios  of  traffic  types:  data,  teletype,  facsimile,  and  voice. 
Specifically,  the  percentage  of  data  will  be  increased  at  the  expense  of 
the  percentage  of  voice. 

2. 6. 4.1  Quantitative  Measure  of  Effectiveness 

Percentage  of  GOS  degradation  due  to  increasing  ratio  of  data/ 
voice  traffic  types. 

2. 6. 4. 2 Estimation  Procedures 

1116  actual  “easure  of  the  ability  to  adapt  to  various  ratios  of 
traffic  types  will  be  the  percentage  of  change  in  grade  of  service  due  to 
increasing  the  percentage  of  data  traffic.  If  a saturation  point  exists, 
k®  identified.  The  system  busy-hour  traffic  (from  the  scenario) 
win  be  identified  by  traffic  type  and  converted  to  a common  denominator, 
imd  current  percentage  levels  will  be  established.  The  percentage  of 
data  traffic  will  be  increased  at  the  expense  of  voice  traffic  and  the  re- 
sultant GOS,  computed  by  SIMCE,  will  be  plotted  accordingly. 


Other  indications  of  data  transmission  will  be  indicated  by  the 
effect  of  the  data  rate  and  bandwidth  requirements  for  data  transmission 
on  Information  intelligibility  and  susceptibility  to  jamming  of  such  sys- 
tems as  TOS  and  TACFIRE.  The  determination  of  these  requirements  will  be 
subjective,  and  will  be  based  on  a qualitative  evaluation  by  communications 
analysts.  This  will  be  in  the  form  of  a qualitative  MOE. 

2*6*4*3  Assumptions  and  Estimation  Conditions 


Messenger  service  is  not  included  in  the  computation  of  percen- 
tages  of  traffic  types.  As  the  ratio  of  data-to-voice  traffic  increases, 
traffic  volume  will  increase.  The  extent  of  the  increase  will  be  estimated 
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by  the  communications  analysts  and  used  as  a factor  in  evaluating  GOS.  The 
differences  between  all  dlgltal/hybrid/analog  systems  will  be  considered. 

2.6.5  Aspect:  Ability  to  Add  Subscribers 


The  concepts  will  be  evaluated  at  the  echelons  of  Brigade  and  Divi- 
sion according  to  their  ability  to  accommodate  additional  subscribers 
(smaller  in  number  than  a company).  Specifically,  the  RF  spectrum  and 
logistical  support  requirements  will  be  investigated. 

2.6.5. 1 Quantitative  Measure  of  Effectiveness 
Not  applicable. 

2.6. 5. 2 Estimation  Procedures 

Answers  to  the  following  questions  form  the  basis  for  concept 
comparison: 

° When  additional  subscribers  enter  the  area,  how  do  the 
RF  spectrum  requirements  change? 

0 When  additional  subscribers  enter  the  area,  how  do  the 
logistical  support  requirements  change? 

The  answers  to  these  questions  will  be  based  on  a qualitative  evaluation 
of  each  of  the  concepts  performed  by  communications  analysts.  These  ans- 
wers will  be  in  the  form  of  a qualitative  MOE. 

2. 6. 5. 3 Assumptions  and  Estimation  Conditions 

The  concepts  will  not  be  compared  for  changes  in  security  due  to 
additional  subscribers. 

2.6.6  Aspect:  System  Modularity  (ability  to  fragment  the  system  without 
degradation) 

The  concepts  will  be  evaluated  at  the  echelons  of  Brigade,  Division, 

Corps,  and  Theater  Army  according  to  their  ability  to  provide  continuity 
of  service  to  the  main  body  and,  at  the  same  time,  to  satisfy  the  communi- 
cations requirements  of  a unit  on  a special  mission  and  physically  separated 
from  the  main  body.  The  ability  to  fragment  the  system  will  be  Influenced 
by  quality  of  service  and  RF  spectrum  requirements. 

2. 6. 6.1  Quantitative  Measure  of  Effectiveness 
Not  applicable. 

2. 6. 6. 2 Estimation  Procedures 

Answers  to  the  following  questions  form  the  basis  for  concept 
comparison: 
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0 How  do  GOS  and  information  intelligibility  change  when  a 
unit  is  fragmented  from  the  main  body  but  is  still  sup- 
ported by  it? 

0 What  GOS  and  Information  intelligibility  can  this  frag- 
mented unit  expect? 

° How  do  RF  spectrum  requirements  change? 

The  answers  to  these  questions  will  be  subjective  and  based  on  a qualitative 
evaluation  of  each  of  the  concepts  performed  by  communications  analysts. 
These  answers  will  be  in  the  form  of  a qualitative  MOE. 

2.6. 6. 3 Assumptions  and  Estimation  Conditions 

The  concepts  will  not  be  compared  for  changes  in  security  due  to 
system  fragmentation. 

2.6.7  Aspect:  Downtime  Due  to  CP  Displacement 

The  concepts  will  be  evaluated  according  to  their  ability  to  recon- 
stitute the  conrounications  system  after  CP  displacement.  This  ability  will 
be  indicated  by  the  total  time  required  to  accomplish  CP  displacement  and 
by  the  degree  of  communications  loss  due  to  this  displacement. 

2 . 6 . 7 . 1 Quantitative  Measure  of  Effectiveness 
Down  minutes  due  to  CP  displacement. 

2. 6. 7.2  Estimation  Procedures 


Subscribers  that  lose  communications  capability  due  to  CP  dis- 
placement will  be  identified.  A weighting  factor  will  be  applied  to  those 
subscribers  indicating  their  relative  importance  in  terms  of  rank  and  posi- 
tion; i.e.t 


S 

Total  Down  Minutes  = E W_  T_ 

5 o 


where 

S = total  number  of  subscribers  suffering  loss  of  commu- 
nications capability  due  to  CP  displacement 

s = discrete  subscriber,  s»l,  2,  3,  4,  ...  S 

Ws  = weighting  factor  fo.'  subscriber  s 

T - downtime  in  minutes  for  subscriber  s. 

S 


2.6. 7. 3 Assumptions  and  Estimation  Conditions 


The  downtime  in  minutes  for  each  subscriber  will  be  by 
communications  analysts.  Backup  capability  will  be  considered,  and  total 
down  minutes  will  be  calculated  in  two  ways: 


0 By  ignoring  backup  capability 

° By  discounting  down  minutes  for  any  subscriber  with  a 
a backup  capability. 


It  1.  assumed  that  the  forte  can  tolerate  downtime  for  some  subscribers 
with  no  loss  of  combat  effectiveness. 


2.6.8  Aspect:  Ability  to  Operate  in  Dispersed  or  Concentrated  Deployments 


The  concepts  will  be  evaluated  according  to  their  ability  to  func- 
tion in  either  dispersed  or  concentrated  deployments.  The  ability  to  func- 
tion will  be  influenced  by  vulnerability,  survivability,  maintainability, 
l^istical  support  requirements,  mobility,  transportability,  RF  spectrum 
requirements,  and  quality  of  service. 


2. 6. 8.1  Quantitative  Measure  of  Ef fectivenesg 


Not  applicable. 


2.6. 8.2  Estimation  Procedures 


Answers  to  the  following  questions  will  form  the  basis  for  concept 
comparison: 


How  does  susceptibility  (to  weather,  ECM,  ground  or  air 
attack)  differ  in  dispersed  or  concentrated  deployments. 


How  does  the  impact  of  electronic  jamming  or  physical  des- 
truction differ  in  dispersed  or  concentrated  deployments. 


How  do  the  maintenance/logistical  requirements  (for  cor- 
rective maintenance,  software  updates,  and  power  require- 
ments) differ  in  dispersed  or  concentrated  deployments? 


How  does  mobility  (in  terms  of  setup/teardown  time  Jjhe 
ability  to  communicate  while  moving)  differ  in  dispersed 
or  concentrated  deployments? 


How  do  the  number  and  type  of  vehicles  required  to  support 
the  communications  system  differ  in  dispersed  or  concen- 
trated deployments? 


How  do  RF  spectrum  requirements  differ  in  various  opera- 
tional environments? 


How  do  GOS  and  Information  intelligibility  differ  in 
various  operational  environments? 


r 


The  answers  to  these  questions  will  be  subjective  and  based  on  a qualitative 
evaluation  of  each  of  the  concepts  performed  by  communications  analysts. 
These  answers  will  be  in  the  form  of  a qualitative  MOE. 

2.6. 8. 3 Assumptions  and  Estimation  Conditions 

None. 

2.6.9  Aspect;  Hardware  Modularity 

The  concepts  will  be  evaluated  according  to  the  increase  in  system 
performance  that  results  from  hardware  modularity.  This  increase  in  system 
performance  is  influenced  by  changes  in  mobility,  transportability,  logis- 
tical support  requirements,  security,  standardization,  and  maintainability. 

2. 6. 9.1  Quantitative  Measure  of  Effectiveness 
Not  applicable. 

2. 6. 9. 2 Estimation  Procedures 

Answers  to  the  following  questions  will  form  the  basis  for  concept 
comparison: 

° How  does  hardware  modularity  affect  setup/ teardown  time 
and  the  ability  to  communicate  during  movement? 

* How  does  hardware  modularity  affect  portability? 

° How  does  hardware  modularity  affect  logistical  support 
requirements? 

° How  does  hardware  modularity  affect  the  ability  to  convert 
from  nonsecure  to  secure  equipment? 

° How  does  hardware  modularity  affect  the  standardization 
of  CE  equipment? 

* How  does  hardware  modularity  affect  maintainability? 

The  answers  to  these  questions  will  be  based  on  a qualitative  evaluation  of 
each  of  the  concepts  performed  by  communications  analysts.  These  answers 
will  be  in  the  form  of  a qualitative  MOE. 

2.6.9. 3 Assumptions  and  Estimation  Conditions 

The  system  designers  will  provide  information  on  modularity  for 
any  hardware  currently  in  R&D. 
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2.7  AREA:  RELIABILITY 

Reliability  is  defined  as  the  probability  that  the  communications  sys- 
tem perform  its  mission  adequately  for  the  time  Intended  under  the  operation 
conditions  expected  to  be  encountered.  Since  traffic  blockage  is  measured 
separately  under  GOS,  this  area  will  concern  equipment  performance  and  not 
equipment  capacity.  Reliability  includes  the  aspect  of  system  availability. 

2.7.1  Aspect:  System  Availability 

The  concepts  will  be  evaluated  by  calculating  the  probability  that 
equipment  failure  will  not  degrade  system  performance.  This  Involves  mea- 
suring equipment  reliability  and  identifying  routing  capability. 

2. 7. 1.1  Quantitative  Measure  of  Effectiveness 
Percent  system  availability. 

2. 7. 1.2  Estimation  Procedures 

The  system  design  effort  in  Task  V will  provide  TOEs  for  each  unit 
within  an  echelon.  For  the  equipment  specified  in  the  TOEs,  mean  time  between 
failure  (MTBF) , mean  time  to  repair  (MTTR) , and  the  NORM  rate  will  be  calcu- 
lated as  indicated  in  Subsection  2.12.2.  Operational  availability,  A,  for 
each  discrete  type  of  equipment  will  be  computed  by  the  following  equation: 

A - — NORM 

1 ‘ *1 

where  a^  is  inherent  availability  and  equal  to 

MTBF 

MTBF  + MTTR 

If  backup  equipment  exists  on-site,  or  if  an  alternate  routing 
capability  exists,  the  equipment  is  considered  to  be  in  parallel  operation 
at  that  point;  otherwise,  the  equipment  is  considered  to  be  in  series  opera- 
tion. Figure  A-l  demonstrates  a path  of  equipment  in  series;  Figure  A-2 
demonstrates  equipment  in  parallel;  and  Figure  A-3  demonstrates  a series 
of  parallel  configurations  of  equipment. 

Total  availability  with  equipment  in  series,  Atot,  is  a product 
relationship  of  the  individual  (operational)  availabilities: 

*tot  * J *1 

where  A^  ■ the  availability  of  the  ic^  equipment  in  series.  The  avail- 
ability along  the  path  of  Figure  A-l  is  computed  as: 


A (path)  - A(X^)  • A(X2)  • A(X3) 
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That  is,  if 


A(X1)  - A(X2)  “ A(X3)  - 0.9 


then 


A(path)  * 0.729. 


Total  availability  with  equipment  in  parallel  is  calculated  differently, 
since  failure  occurs  only  when  all  equipment  in  parallel  has  failed  simul- 
taneously. Thus, 

*tot  ■ 1 • n (1  ■ v 

j 

where  A represents  the  availability  of  the  equipment  in  parallel.  The 
availability  along  the  path  of  Figure  A-2  is  computed  as: 


That  is,  if 


then 


A(path)  * 1 - (1  - A(Y1))  • (1  - A(Y2)) 

A(Yl)  - A(Y2)  - 0.9 
A(path)  ■ 1 - 0.01  * 0.99. 


Total  availability  of  a system  containing  parallel  configurations  can  be 
expressed  as: 

Atot  " 11 
i 

where  A^  represents  the  availability  of  the  ittl  equipment/configuration  in 
series.  Thus, 


Ai  - 1 - Tip  (1  - Aip) 

where  Alp  represents  the  availability  of  the  pth  equipment  in  configuration 
of  the  i*h  position  in  series,  where: 

p > 1 if  parallel  configuration  exists 

p ■ 1 otherwise. 

The  availability  along  the  path  of  Figure  A-3  is  computed  as: 


L 


A(path) 


(1  - (1  - AfZ^) 


(1  - A(Z2))) 


• (1  - (1  - A(Z3)) 


(1  - A(Z4>)) 


That  is,  if 


A(Z1)  = A(Z2)  = A(Z3)  = A(Z4)  = 0.9 


then 

A(path)  = (0.99)  • (0.99)  - 0.9801. 

The  concepts  under  consideration  contain  parallel  configurations 
in  series,  and  therefore  will  be  evaluated  by  the  above  procedure.  Criti- 
cal paths  ->f  equipment,  based  on  their  importance  to  mission  performance, 
will  be  identified  by  communications  analysts.  Availability  for  these 
paths  will  be  calculated,  and  a mean  and  variance  of  these  availabilities 
will  comprise  the  actual  M0E. 

2. 7. 1.3  Assumptions  and  Estimation  Conditions 

None. 


2.8  AREA:  LOGISTICAL  SUPPORT 

Logistical  support  is  defined  as  the  provision  of  adequate  materiel 
and  services  to  a military  force  to  assure  successful  accomplishment  of 
assigned  missions.  For  the  communications  system,  logistical  support 
includes  the  following  aspects: 

° Ease  of  providing  required  parts  support 
° Power  requirements. 

2.8.1  Aspect:  Ease  of  Providing  Required  Parts  Support 

The  concepts  will  be  evaluated  according  to  the  size  and  weight  of 
equipment  in  the  inventory  required  to  support  the  communications  system. 
Additionally,  the  NORS  rates  of  critical  equipment  will  be  indicated. 
Stockage  levels  will  be  examined,  and  parts/maintenance  support  centers 
will  be  evaluated  with  respect  to  their  proximity  to  using  units. 

2.g. 1.1  Quantitative  Measure  of  Effectiveness 

• NORS  rate  for  critical  components  of  the  system; 

* Cubic  feet  of  storage  to  maintain  the  necessary  spare 
parts  inventory  in  support  of  the  comsnmications  system. 
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2 . 8 . 1 . 2 Estimation  Procedures 

The  system  design  effort  in  Task  V will  provide  TOEs  for  each  unit 
within  an  echelon.  These  TOEs  indicate  quantities  of  types  of  equipment 
required.  Spare  parts  required  for  preventive  and  corrective  maintenance 
of  equipment  will  be  identified  (including  throw-away  parts),  and  the  stor- 
age volume  (in  cubic  feet)  required  for  spare  parts  will  be  calculated. 

The  NORS  rate  for  critical  components  of  the  system  will  be  cal- 
culated from  empirical  data  provided  by  the  Army  Logistics  Management 
Center  (ALMC)  at  Fort  Lee. 

Additionally,  answers  to  the  following  questions  will  be  used  to 
compare  the  concepts; 

" What  stockage  levels  are  required  to  support  the  system? 

° How  do  the  locations  of  parts/maintenance  support  centers 
affect  the  ability  to  support  the  using  units? 

The  answers  to  these  questions  will  be  subjective  and  based  on  a qualita- 
tive evaluation  of  each  of  the  concepts  performed  by  communications  analysts. 
These  answers  will  be  in  the  form  of  a qualitative  MOE. 

2.8.1. 3 Assumptions  and  Estimation  Conditions 

For  all  equipment  in  the  current  inventory,  spare  parts  require- 
ments can  be  identified  from  technical  manuals.  For  equipment  currently  n 
R&D,  the  system  designers  will  provide  this  information. 

Storage  requirements  for  spare  parts  will  also  be  provided  by  sys- 
tem designers.  Empirical  data  necessary  for  the  calculation  of  NORo  rates 
will  be  GFI. 

Consummables  needed  to  support  manpower  requirements,  such  as  food 
and  clothing,  will  not  be  considered. 

2.8.2  Aspect:  Power  Requirements  (generators,  batteries,  etc.) 

The  concepts  will  be  evaluated  according  to  power  requirements.  The 
different  sources  of  power  will  be  identified,  and  the  total  requirements 
for  each  type  of  source  will  be  determined. 

2.8.2. 1 Quantitative  Measure  of  Effectiveness 

Total  power,  by  source  type,  required  to  support  the  communica- 
tions system. 
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2. 8. 2. 2 Estimation  Procedures 


The  system  design  effort  in  Task  V will  provide  TOEs  for  each  unit 
within  an  echelon.  These  TOEs  indicate  quantities  of  types  of  equipment 
required  for  each  alternative.  For  this  equipment,  both  primary  and  backup 
power  requirements  will  be  considered  and  totaled  by  source  type. 

2.8.2. 3 Assumptions  and  Estimation  Conditions 

Gasoline  for  transport  vehicles  will  be  excluded.  For  all  equip- 
ment in  the  current  Inventory,  power  requirements  are  indicated  in  tech- 
nical manuals.  For  equipment  currently  in  R&D,  the  system  designers  will 
provide  this  information. 


2.9  AREA:  SECURITY 

Communications  security  is  the  protection  that  results  from  all  measures 
designed:  1)  to  deny  unauthorized  persons  information  of  value  that  might 
be  derived  from  the  possession  and  study  of  telecommunications,  or  2)  to 
mislead  unauthorized  persons  in  their  Interpretation  of  the  results  of 
such  possession  and  study.  Communications  security  includes:  1)  crypto- 
security; 2)  transmission  security;  3)  emission  security;  and  A)  physical 
security  of  communications  security  material  and  information. 

Cryptosecurity  is  the  component  of  communication*  security  that 
results  from  the  provision  of  technically  sound  cryptosystems  and  their 
proper  use. 

Transmission  security  is  the  component  of  communications  security 
that  results  from  all  measures  designed  to  protect  transmission  from  inter- 
ception and  exploitation  by  means  other  than  cryptoanalysis. 

Emission  security  is  the  component  of  communications  security 
that  results  from  all  measures  taken  to  deny  unauthorized  persons  informa- 
tion of  value  that  might  be  derived  from  intercept  and  analysis  of  compro- 
mising emanations  from  cryptoequipment  and  telecommunications  systems. 

Physical  security  is  the  component  of  communications  security  that 
results  from  all  physical  measures  necessary  to  safeguard  classified  equip- 
ment, material,  and  documents  from  access  thereto  or  observations  thereof 
by  unauthorized  persons. 

For  the  purpose  of  this  study,  communications  security  includes 
the  following  aspects: 

* Ability  to  provide  increased  secure  communications; 

0 Limitations  imposed  through  increased  security; 
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Ability  to  accommodate  increasing  ratios  of  secure  to 
nonsecure  subscribers; 

Ability  to  satisfy  interface  security  requirenwnts ; 

Ability  to  restore  secure  communications  after  compromise; 
0 Degree  of  security. 

Interceptibility  is  an  aspect  previously  covered  under  security;  however, 
it  is  addressed  within  the  area  of  vulnerability. 

2*9.1  Aspect : Ability  to  Provide  Increased  Secure  Communications 

The  concepts  will  be  evaluated  according  to  their  ability  to  provide 
secure  communications  by  transmission  mode  to  those  who  need  it.  The  fol- 
lowing modes  will  be  considered:  voice  (wideband  and  narrowband,  analog 
and  digital),  data,  teletype,  and  facsimile.  Evaluation  will  also  include 
wire  and  cable/RF  tradeoffs,  TCCF  functions,  RF  spectrum  requirements, 
and  terminal  equipment. 

2. 9. 1.1  Quantitative  Measure  of  Effectiveness 
Not  applicable. 

2. 9. 1.2  Estimation  Procedures 

Answers  to  the  following  questions  will  form  the  basis  for  concept 
comparison: 

When  considering  wire  and  cable/RF  tradeoffs,  what  are 
the  effects  of  the  differences  in  setup/teardown  time, 
support  requirements  (manpower  and  logistics  commitments), 
and  degree  of  security  (link  versus  end-to-end) , and  how 
do  these  differences  relate  to  each  concept? 

How  does  the  organizational  structure  of  TCCF  affect 
its  ability  to  perform  the  functions  of  secure  circuit 
monitoring,  reporting,  restoring,  and  patching? 

* What  are  the  effects  of  the  increased  RF  spectrum  and 
terminal  equipment  requirements  caused  by  increasing 
security  for  each  mode  of  transmission? 

The  answers  to  these  questions  will  be  based  on  a qualitative  evaluation 
of  each  of  the  concepts  performed  by  the  communications  analysts.  These 
answers  will  be  in  the  form  of  a qualitative  MOE. 

2.9. 1.3  Assumptions  and  Estimation  Conditions 

The  following  assumptions  and  estimation  conditions  are  made: 


A-33 


4 


0 Trained  operators  will  be  available; 


° Cryptosystems  to  be  employed  will  be  secure  from 
exploitation; 


O 


/ 


The  number  of  secure  terminal 
vary  among  the  concepts. 


subscribers  will  not 


* 


2.9.2  Aspect:  Limitations  imposed  Through  Increased  Security 

• ** 

The  concepts  will  be  evaluated  according  to  the  degwe  of  reduction 
in  system  performance  caused  by  increased  demands  on  the  s^tera  when  secu- 
rity is  provided.  These  limitations  are  caused  by  increased  space  and 
weight,  increased  logistical  support  requirements,  increased  RF  spectrum 
requirements,  increased  setup/ teardown  time,  the  mix  of  secure/nonsecure 
subscribers  at  a switch,  and  lower  noise  tolerance  necessary  for  secure 
transmission. 

2.9. 2.1  Quantitative  Measure  of  Effectiveness 


Not  applicable. 


2.9.2. 2 Estimation  Procedures 


Answers  to  the  following  questions  will  form  the  basis  for  concept 
comparison: 

0 How  do  the  increased  equipment  requirements  for  security 
increase  space  and  weight  considerations  (system/ user)? 

0 What  is  the  increase  in  manpower,  logistical,  and  crypto 
material  requirements  resulting  from  increased  transmis- 
sion security? 

• What  is  the  increase  in  RF  spectrum  requirements  result- 
ing from  increased  transmission  security? 

0 What  is  the  increase  in  setup/teardown  time  resulting  from 
increased  transmission  security? 

0 Assuming  that  a mix  of  secure/nonsecure  subscribers  is 
inevitable,  what  limitations  are  imposed  upon  the  switch? 

0 What  is  the  effect  of  the  lower  noise  tolerance  necessary 
for  transmission  security? 

The  answers  to  these  questions  will  be  based  on  a qualitative  evaluation 
of  oach  of  the  concepts  performed  by  communications  analysts.  These  ans- 
wers will  be  in  the  form  of  a qualitative  MOE. 

\ 
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2.9. 2. 3 Assumptions  and  Estimation  Conditions 
COMSEC  equipment  will  be  in  the  hands  of  trained  operators. 

2.9.3  Aspect:  Ability  to  Accommodate  Increasing  Ratios  of  Secure  to  Non- 
secure  Subscribers 

The  concepts  will  be  evaluated  according  to  their  ability  to  ac- 
commodate a system-wide  increase  in  the  percentage  of  secure  subscribers, 
with  the  goal  to  eventually  achieve  100  percent  security.  Factors  that 
influence  this  ability  include  RF  spectrum  requirements,  logistical  support 
requirements,  and  transportability. 

2.9. 3.1  Quantitative  Measure  of  Effectiveness 
Not  applicable. 

2.9. 3.2  Estimation  Procedures 

Answers  to  the  following  questions  will  form  the  basis  for  concept 
comparison: 

° What  limitations  to  increasing  the  number  of  secure  sub- 
scribers are  imposed  by  RF  spectrum  requirements? 

° What  limitations  to  increasing  the  number  of  secure  sub- 
scribers are  imposed  by  an  inability  to  meet  the  increased 
manpower,  logistical,  and  crypto  material  requirements? 

0 What  limitations  to  increasing  the  number  of  secure  sub- 
scribers are  imposed  by  space  or  weight  considerations? 

0 What  limitations  to  increasing  the  number  of  secure  sub- 
scribers are  imposed  by  situations  of  high  risk  of  compro- 
mise or  capture  (proximity  to  enemy,  overflight)? 

0 What  limitations  to  increasing  the  number  of  secure  sub- 
scribers are  imposed  by  the  mix  of  secure/noosecure  sub- 
scribers at  a switch? 

0 What  limitations  to  increasing  the  number  of  secure  sub- 
scribers are  imposed  by  adding  subscribers  (units  or 
• individuals)? 

The  answers  to  these  questions  will  be  based  on  a qualitative  evaluation 
of  each  of  the  concepts  performed  by  communications  analysts.  These  ans- 
wers will  be  in  the  form  of  a qualitative  MOE. 

2. 9. 3. 3  Assumptions  and  Estimation  Conditions 

Cost  implications  will  be  addressed  during  sensitivity  analysis  and 
will  not  be  considered  during  concept  evaluation  for  this  appect. 
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2.9.4  Aspect:  Ability  to  Satisfy  Interface  Security  Requirements 


The  concepts  will  be  evaluated  according  to  their  ability  to  satisfy 
interface  security  requirements  on  the  following  levels:  allied,  Joint, 
interservice,  and  DCS,  both  laterally  and  vertically.  Consideration  will 
be  given  to  cryptoequipment  interoperability  and  compatibility  of  orocedures. 

2 . 9 . 4 . 1 Quantitative  Measure  of  Effectiveness  — 

Not  applicable. 

2 . 9 . 4 . 2 Estimation  Procedures 

Answers  to  the  following  questions  will  form  the  basis  for  concept 
comparison: 

0 What  is  the  status  of  cryptoequipment  interoperability, 

and  how  does  this  affect  security  interface  capability?  _ 

° What  is  the  status  of  crypto  procedures  conpatlbllity , and 
how  does  this  affect  security  interface  capability? 

The  answers  to  these  questions  will  be  based  on  a qualitative  evaluation  of 
each  of  the  concepts  performed  by  communications  analysts.  These  answers 
will  be  in  the  form  of  a qualitative  MOE. 

2.9.4. 3 Assumptions  and  Estimation  Conditions 
None. 

2.9.5  Aspect:  Ability  to  Restore  Security  After  Compromise 

The  concepts  will  be  evaluated  according  to  their  ability  to  restore 
security  after  compromise  of  hardware  or  crypto  material.  Compromise  in- 
cludes capture  or  successful  cryptoanalysis  by  the  enemy.  In  the  event  of 
compromise,  it  is  the  responsibility  of  TCCF  and  cryptosecurity  personnel 
to  coordinate  the  restoration  of  security. 

2. 9. 5.1  Quantitative  Measure  of  Effectiveness 
Not  applicable. 

2. 9. 5.2  Estimation  Procedures 

■ . i ■ ■ ...  ■■  ■ ■■  i 

Answers  to  the  following  questions  will  form  the  basis  for  concept 
comparison : 

• What  is  the  impact  on  security  of  hardware  compromise? 


• What  replacement  capability  exists  in  the  event  of  hard- 
ware compromise? 

k 


What  is  the  impact  on  security  of  compromise  of  crypto 
material? 


I 


l 
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0 What  are  the  capabilities  of  the  system  in  redistributing 
(by  physical  or  electronic  means)  crypto  material  in  the 
event  of  compromise? 

° How  do  crypto  logistics  procedures  affect  the  ability  to 
rapidly  restore  security  after  compromise? 

• What  influence  does  the  organizational  structure  of  TCCF 
have  on  the  ability  to  react  to  compromise? 

The  answers  to  these  questions  will  be  based  on  a qualitative  evaluation  of 
each  of  the  concepts  performed  by  communications  analysts.  These  answers 
will  be  in  the  form  of  a qualitative  MOE. 


2.9. 5. 3 Assumptions  and  Estimation  Conditions 

The  following  assumptions  and  estimation  conditions  are  made: 

• COMSEC  equipment  will  be  in  the  hands  of  trained  operators; 

° No  effort  will  be  made  to  evaluate  the  ability  to  detect 
the  compromise  situation  (for  the  purposes  of  this  study, 
it  is  assumed  that  the  compromise  situation  is  known  to 
have  occurred) ; 

0 Circuit  restoration  will  not  be  evaluated  as  a part  of 
this  aspect. 

In  that  some  system  features  relate  to  more  than  one  of  the  above 
items,  the  possibility  of  double-weighting  exists  and  will  be  addressed 
during  the  concept  evaluations  for  this  aspect. 

2.9.6  Aspect:  Degree  of  Security 

The  concepts  will  be  evaluated  according  to  the  degree  of  security 
that  is  provided.  Specifically,  end-to-end  security  and  link  security  will 
be  addressed. 


2.9. 6.1  Quantitative  Measure  of  Effectiveness 

• Number  of  subscribers  provided  with  end-to-end  security  . 

Two  of  the  original  63  quantitative  MOEs  have  since  been  dropped  (when  the 
number  of  MOEs  was  reduced  to  60).  The  following  MOEs  have  been  deleted: 


Number  of  subscribers  not  provided  with  end-to-end  security 
who  are  provided  with  link  security; 

Percentage  of  subscribers  not  provided  with  end-to-end 
security  who  can  be  upgraded  to  end-to-end  security  with 
a modular  addition  to  their  equipment. 
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2. 9. 6. 2 Estimation  Procedures 


The  system  design  effort  in  Task  V will  provide  TOEs  for  each  unit 
within  an  echelon.  From  these  TOEs,  the  equipments  that  provide  end-to-end 
security  and  link  security  will  be  identified.  This  will  be  used  to  deter- 
mine the  number  of  subscribers  in  the  organization  provided  with  end-to-end 

security. 


2.9.6. 3 Assumptions  and  Estimation  Conditions 

Xt  is  recognized  that  a commander  can,  on  the  basis  of  physical 
security,  declare  that  an  area  has  end-to-end  security.  This  situation 
will  be  considered  in  estimating  the  number  of  subscribers  with  end-to-end 
security. 


2.10  AREA:  OPERABILITY 

Operability  is  defined  as  the  ease  of  using  the  communications  system 
so  that  it  adequately  serves  the  needs  of  the  user.  Operability  includes 
the  following  aspects: 

• Degree  of  difficulty  in  system  operation 

* Service  features. 

2.10.1  Aspect:  Degree  of  Difficulty  in  System  Operation 

The  concepts  will  be  evaluated  according  to  their  directory  re- 
quirements, call  setup  procedures,  and  MOS  requirements  for  system  operation. 

2.10.1.1  Quantitative  Measure  of  Effectiveness 

° Number  of  personnel,  by  MOS,  required  to  operate  the  com- 
munications system. 

Two  of  the  original  63  MOEs  have  since  been  replaced  by  a qualitative  MOE  on 
directory  requirements.  The  MOEs  that  were  deleted  are  as  follows: 

• Number  of  listings  required  in  the  directory; 

• Number  of  users  that  require  the  directory. 

2.10.1.2  Estimation  Procedures 


The  system  design  effort  In  Task'  V will  provide  manpower  require- 
ments, by  MOS,  for  operating  and  maintaining  the  equipment.  The  number  of 
personnel  required  for  operations  will  be  totaled  by  MOS. 
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Answers  to  the  following  questions  will  form  the  basis  for  the 
qualitative  comparison  of  the  concepts: 

Can  directory  changes  be  kept  current? 

How  does  a unit  move  affect  directory  requirements? 

What  is  the  degree  of  difficulty/ complexity  in  the  call 
setup  procedure? 

To  what  degree  does  the  calling  party  need  to  know  the 
actual  location  of  the  party  being  called? 

The  answers  to  these  questions  will  be  based  on  a qualitative  evaluation  of 
each  of  the  concepts  performed  by  communications  analysts.  These  answers 
will  be  in  the  form  of  two  qualitative  MOEs: 

Measurement  of  the  ease  of  maintaining  a current 
directory; 

Measurement  of  the  ease  of  placing  a telephone  call. 

2. iO.l. 3 Assumptions  and  Estimation  Conditions 

The  physical  characteristics  of  the  equipment  are  such  that  the 
ease  of  operating  actual  equipment  does  not  significantly  differ  among  the 
concepts.  ° 

2.10.2  Aspect : Service  Features 

Service  features  are  those  features  that  Increase  system  effective- 
ness by  providing  capabilities  not  essential  but  which  are  expedient  and 
convenient.  A system  either  has  the  capability  or  it  does  not. 

2.10.2.1  Quantitative  Measure  of  Effectiveness 
Not  applicable. 

2.10.2.2  Estimation  Procedures 

Answers  to  the  following  questions  form  the  basis  for  concept 
comparison: 

* Does  the  concept  offer  call  reinitiate? 

0 Does  the  concept  offer  command  override? 

Does  the  concept  offer  prearranged  conference  calls  (one 
number  gets  all  conferees)? 
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0 Does  the  concept  offer  adequate  manual  backup? 

0 Does  the  concept  offer  callup  conference  calls? 

• Does  the  concept  offer  positive  ringback? 

0 Does  the  concept  offer  line  grouping? 

• Does  the  concept  offer  automatic  signaling? 

• Does  the  concept  offer  automatic  routing? 

• Does  the  concept  offer  compressed/abbreviated  dialing? 
° Does  the  concept  offer  call  transfer? 

Assumptions  and  Estimation  Conditions 


The  answers  to  these  questions  will  be  provided  by  communications 


analysts. 


2.11  AREA:  STANDARDIZATION 

Standardization  is  defined  as  the  ability  of  a communications  system 
design  to  use  common,  compatible,  or  interchangeable  equipment  and  supplies. 
Standardization  includes  the  aspect  of  multiplicity  of  CE  equipment. 


I 


2.11.1  Aspect:  Multiplicity  of  CE  Equipment 

The  degree  of  standardization  of  CE  equipment  will  be  determined 
for  each  concept.  Specifically,  the  number  of  categories  or  families  of 
CE  equipment  will  be  computed. 

2.11.1.1  Quantitative  Measure  of  Effectiveness 

Number  of  categories  of  CE  equipment  required  by  each  concept. 

2.11.1.2  Estimation  Procedures 

Hie  system  design  effort  in  Task  V will  provide  TOEs  for  each 
unit  within  an  echelon.  The  TOEs  indicate  quantities  and  types  of  equip- 
ment to  be  employed.  The  next  three  steps  are  as  follows: 

• Determine  the  families  into  which  the  equipment  is  to 
be  categorized; 

• Place  each  piece  of  equipment  in  the  appropriate  family 
of  equipment; 

• Enumerate  the  families  of  equipment. 

2.11.1.3  Assumptions  and  Estimation  Conditions 

Categorization  by  families  for  all  equipment  (including  those 
currently  in  R&D)  will  be  performed  by  the  system  designers. 
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2.12  AREA:  MAINTAINABILITY 


Maintainability  is  defined  as  the  ease  with  which  the  necessary  pre- 
ventive, corrective,  and  software  maintenance  can  be  provided  for  the  com- 
munications system.  Maintainability  Includes  the  following  aspects: 

* Ease  of  providing  preventive  maintenance 

* Ease  of  providing  corrective  maintenance 
0 Ease  of  updating  software. 

2.12.1  Aspect:  Ease  of  Providing  Preventive  Maintenance 

The  concepts  will  be  evaluated  according  to  the  amount  of  scheduled 
maintenance  (manhours  by  MOS)  required  for  the  system  and  the  ease  of  pro- 
viding that  maintenance.  This  ease  will  be  determined  by  considering  the 
physical  location  of  the  equipment,  test  equipment,  and  spare  parts 
required  for  maintenance,  and  the  downtime  that  must  be  scheduled  for 
the  maintenance. 

2.12.1.1  Quantitative  Measure  of  Effectiveness 

• Total  manhours,  by  MOS,  to  provide  preventive  maintenance 
for  the  system; 

* Percentage  of  total  manhours  of  preventive  maintenance 
that  can  be  performed  without  the  need  for  additional 
test  equipment; 

° Cubic  feet  of  storage  necessary  for  spare  parts  required 
in  the  inventory  for  preventive  maintenance. 

2.12.1.2  Estimation  Procedures 

The  system  design  effort  in  Task  V will  provide  TOEs  for  each  unit 
within  an  echelon.  These  TOEs  indicate  quantities  of  types  of  equipment 
required  for  each  alternative.  For  the  ..pment  of  each  alternative,  the 
MDS  required  for  maintenance  and  the  requ:  »ed  scheduled  maintenance  will  be 
Identified.  From  this  information,  the  total  manhours,  by  MOS,  to  provide 
preventive  maintenance  to  the  system  will  be  calculated. 

By  identifying  the  scheduled  preventive  maintenance  that  can  be 
accomplished  without  the  u9e  of  additional  equipment,  a percentage  of  such 
maintenance  in  terms  of  manhour  requirements  can  be  calculated. 

The  system  design  effort  will  provide  information  that  indicates 
the  storage  volume  required  for  spare  parts  needed  in  the  inventory  for 
preventive  maintenance. 

Answers  to  the  following  questions  will  form  the  basis  for  the 
qualitative  comparison  of  the  concepts: 

i 


To  what  degree  does  the  physical  location  (remoteness) 
of  deployed  equipment  result  in  an  additional  burden  in 
providing  scheduled  maintenance? 

How  does  the  required  downtime  that  must  be  scheduled  for 
maic.tenance  affect  system  performance? 

I 

The  answers  to  these  questions  will  be  based  on  a qualitative  evaluation  of 
e;'ch  of  the  concepts  performed  by  communications  analysts.  These  answers 
will  be  in  the  form  of  a qualitative  MOE. 

2.12.1.3  Assumptions  and  Estimation  Conditions 

For  all  equipment  in  the  current  inventory,  associated  MOSs, 
scheduled  preventive  maintenance,  and  spare  parts  requirements  can  be  iden- 
tified from  technical  manuals.  For  equipment  currently  in  R&D,  the  system 
designers  will  provide  this  information.  Storage  requirements  for  spare 
parts  will  also  be  provided  by  syutem  designers. 

2.12.2  Aspect:  Ease  of  Providing  Corrective  Maintenance 

The  concepts  will  be  evaluated  according  to  the  amount  of  correc- 
tive maintenance  (manhours  by  MOS)  required  for  the  system  and  the  ease  of 
providing  that  maintenance.  The  amount  of  corrective  maintenance  required 
will  be  determined  by  the  MTBF  and  the  MTTR  for  the  equipment.  The  ease 
of  providing  the  maintenance  will  be  determined  by  considering  the  physical 
location  of  the  equipment  in  relation  to  the  test  equipment,  spare  parts, 
and  manpower  (by  MOS)  that  is  required  for  the  maintenance. 

2.12.2.1  Quantitative  Measure  of  Effectiveness 

* Estimated  total  manhours,  by  MOS,  required  to  provide 
corrective  maintenance  for  the  system; 

Percentage  of  estimated  total  manhours  of  corrective 
maintenance  that  can  be  performed  without  the  need  for 
additional  test  equipment; 

Cubic  feet  of  storage  necessary  for  spare  parts  required 
in  the  current  inventory  for  corrective  maintenance; 

NORM  rate  for  the  components  of  the  system. 

2.12.2.2  Estimation  Procedures 

The  system  design  effort  in  Task  V will  provide  TOEs  for  each 
unit  within  an  echelon.  These  TOEs  indicate  quantities  of  types  of  equip- 

T\I*quired  for  each  alternative.  For  each  component  of  each  alternative, 
the  MOS  required  for  maintenance  will  be  specified.  On  the  basis  of  engi- 
neering experience  or  accumulated  data  on  past  failures  and  repair  times, 
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the  MTBF  and  MTTR  will  be  determined  for  the  equipment.  Within  the  calcu- 
lation of  MTTR  will  be  the  estimated  manhours  required  to  make  the  repair. 
From  this  information,  the  total  manhours  (by  MOS)  tc  provide  corrective 
maintenance  to  the  system  will  be  estimated. 

The  above  information  will  involve  Itemizing  specific  expected 
repair  work  and  the  time  required  to  accomplish  these  specific  repairs. 

By  categorizing  these  repair  needs  into  those  that  require  and  those  that 
do  not  require  additional  test  equipment,  a percentage  is  obtained  that 
indicates  the  estimated  total  manhours  of  corrective  maintenance  that  can 
be  performed  without  additional  test  equipment. 

The  system  design  effort  will  provide  information  on  the  storage 
volume  required  for  spare  parts  needed  in  the  inventory  for  corrective 
maintenance . 

The  NORM  rate  will  be  calculated  from  empirical  data  provided  by 
the  Army  Logistics  Management  Center  ac  Fort  Lee. 

Answers  to  the  following  questions  will  form  the  basis  for  the 
qualitative  comparison  of  the  concepts : 

0 What  is  the  capability  of  TCCF  in  detecting  and  iden- 
tifying equipment  failure? 

° To  what  degree  does  the  physical  location  (remoteness) 
of  deployed  equipment  result  in  an  additional  burden  in 
providing  corrective  maintenance? 

The  answers  to  these  questions  will  be  based  on  a qualitative  evaluation 
of  each  of  the  concepts  performed  by  communications  analysts.  These  ans- 
wers will  be  in  the  form  of  a qualitative  MOE. 

2.12.2.3  Assumptions  and  Estimation  Conditions 

For  all  equipment  in  the  current  inventory,  MOS  and  spare  parts 
requirements  will  be  identified  from  technical  manuals.  For  equipment  cur- 
rently in  R&D,  the  system  designers  will  provide  this  information. 

Storage  requirements  for  spare  parts  will  also  be  provided  by 
system  designers.  Empirical  data  necessary  for  the  calculation  of  NORM 
rates  will  be  GFI. 

2.12.3  Aspect:  Ease  of  Software  Updates 

The  concepts  will  be  evaluated  according  to  the  estimated  time,  in 
manhours  by  skill  level,  to  perform  software  modifications  either  on  a con- 
tinual basis  or  as  required  by  any  special  situation.  The  ease  of  pro- 
viding these  updates  in  the  field  is  further  indicated  by  the  extra  person- 
nel required  (in  ad  lit ion  to  on-site  operations  and  maintenance  personnel) 


and  by  the  extra  software /hardware  aids  needed  for  update  tests  and  debug- 
ging procedures. 

2.12.3.1  Quantitative  Measure  of  Effectiveness 

0 Manhours  per  language  (skill  level)  for  continual  needs; 

° Manhours  per  language  for  each  special  situation  that 
dictates  software  update. 


2.12.3.2  Estimation  Procedures 

Communications  analysts,  in  conjunction  with  system  designers, 
will  perform  the  following  steps: 

0 Identify  system  software  that  might  require  modification 
in  a changing  environment; 

° Determine  situations  that  dictate  software  modification; 

° Identify  situations  that  can  be  considered  continual; 

° Indicate  the  lang-iage  and  estimate  the  extend  of  modifi- 
cation in  terms  of  manhours  required  for  individuals 
proficient  iu  that  language; 

° Summarize  manhours  per  language  (skill  level)  for  con- 
tinual needs  and  also  for  each  special  situation  that 
dictates  software  modification. 


In  addition,  answers  to  the  following  questions  w'll  be  used  to 
compare  the  concepts: 

0 In  addition  to  on-site  operations  ana  m-.  nee  person- 

nel, what  personnel  are  required  o pu.Ov«  software  up- 
dates in  the  field? 


° What  extra  software/hardware  ' 'a*  — *dc  >t  update 

tests  and  debugging  procedures? 


The  answers  to  these  questions  will  be  based  on  a quaxita 
of  each  of  the  concepts  performed  by  connunicatior  ..  V 
wsrs  will  be  in  the  form  of  a qualitatw*-  MOE. 
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'v*  ie  ans- 


2.12.3.3  Assumptions  and  Istimaticm  Cordltions^ 


2.13  AREA:  RF  SPECTRUM  REQUIREMENTS 

TVo  factors  are  Included  In  the  evaluation  of  spectrum  requirements 
for  each  concept:  the  amount  of  RF  bandwidth  to  support  the  concept,  and 
the  flexibility  of  necessary  frequency  allocations.  RF  spectrum  require- 
ments Include  the  following  aspects: 

° RF  bandwidth  requirements 
* Flexibility  of  frequency  allocation. 


2.13.1  Aspect:  RF  Bandwidth  Requirements 

This  aspect  examines  the  amount  of  radio  frequency  spectrum  required 
to  support  the  operation  of  a candidate  concept. 

2.13.1.1  Quantitative  Measure  of  Effectiveness 

Spectrum  requirements  output  from  EMC/EMV  analysis. 

2.13.1.2  Estimation  Procedures 

The  EMC/EMV  analysis  will  provide  an  output  that  lists  the  number 
of  frequencies  (by  major  band  category)  needed  to  deploy  a candidate  con- 
cept. Adjustments  will  be  made,  where  appropriate,  when  nqnstandard  chan- 
nel widths  are  employed. 

2.13.1.3  Assumptions  and  Estimation  Conditions 
None. 

2.13.2  Aspect:  Flexibility  of  Frequency  Allocation 

This  aspect  examines  each  candidate  system  In  terms  of  the  flexibi- 
lity offered  In  satisfying  frequency  allocation  requirements. 


2.13.2.1  Quantitative  Measure  of  Effectiveness 
Not  applicable. 

2.13.2.2  Estimation  Procedures 


This  aspect  will  be  a qualitative  discussion  of  the  flexibility 
a candidate  concept  offers  system  managers  In  the  assignment  of  frequencies 
and  channels  to  users.  The  discussion,  as  taken  from  the  "desk-level"  EMC / 
EMV  supplementary  evaluation,  leads  to  conclusions  which  will  consider 
International,  national,  allied,  and  other  service  frequency  requirements 
and  usage  in  the  area  of  operations,  as  well  as  co-site  needs. 
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2.13.2.3  Assumptions  and  Estimation  Conditions 


None. 


2.14  ARFA;  ELECTROMAGNETIC  COMPATIBILITY 

EMC  is  the  ability  of  communications-electronics  equipments,  subsys- 
tems, and  systems,  together  with  electromagnetic  devices,  to  operate  in 
their  intended  operational  environments  without  suffering  or  causing  unac 
cep  table  degradation  due  to  unwanted  electromagnetic  radiation  or  response. 
EMC  includes  the  following  aspects: 

0 INTACS  compatibility 

• INTACS/other  Army  CE  systems  cor.q>atibility. 

2.14.1  Aspect:  INTACS  Compatibility 

Compatibility  is  defined  as  the  capability  of  electronic  equipment 
to  operate  in  an  environment  in  which  only  other  radiating  equipment  of 
the  system  is  operating,  without  significant  performance  degradation  caused 
to  or  by  the  other  system  equipment.  INTACS  compatibility  is  measured  in 
terms  of  the  impact  of  unintentional  electromagnetic  interference  on  other 

equipment  in  INTACS. 

2.14.1.1  Quantitative  Measure  of  Effectiveness 

Weighted  average  of  EMC/EMV  analysis  compatibility  subtest  scores. 

2.14.1.2  Estimation  Procedures 

The  interference  prediction  model  (IPM)  derives  compatibility 
scores  for  each  net  type  after  computing  P(SO)s  of  communications  links  in 
nets  operating  in  the  presence  or  unintentional  interference  in  the  te 
bed.  The  MOE  is  a weighted  arithmetical  mean  of  these  scores  on  the  basis 
of  the  n-unber  of  nets  of  the  net  type  and  a weighted  value  for  the  net  type 
determined  by  communications  analysts*: 


WCP  - 


l Vt  Nt  (CP)t 

t-1 (0<WCP<100) 


T 

l Vt  Nt 
t-1 


where 


WCP  ■ weighted  average  of  EMC/EMV  analysis  compatibi* 
lity  subtest  score 


* Where  applicable,  these  will  be  taken  from  DACE-CMS-E  letter  of  27  Decem- 
ber 1973*  Subject:  Standards  for  Weighting  Communications  and  Electronics 
Nets  and  Links  in  Simulated  Force  Models. 
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T - number  of  different  discrete  net  types 

t - a discrete  net  type,  t“l,  2,  3,  A,  ...  T 

Vt  - values  of  net  type  t 

N - number  of  nets  of  net  type  t in  the  system  (N  - 

1,  2,  3,  A,  ..,)  C 

(CP)t  - compatibility  subscore  for  net  type  t. 

2.14.1.3  Assumptions  and  Estimation  Conditions 

None. 

2.1A.2  Aspect:  INTACS/Other  Army  CE  Systems  Compatibility 

This  aspect  is  to  determine  the  impact  of  unintentional  electromag- 
netic interference  caused  by  INTACS  alternative  concepts  on  other  Army  CE 
nets  in  the  test  bed  (e.g.,  communications  links  associated  with  unattended 
ground  sensors) 

2.1A.2.1  Quantitative  Measure  of  Effectiveness 

EMC/EMV  analysis  of  other  CE  systems  compatibility  scores. 
2.1A.2.2  Estimation  Procedures 

The  output  of  the  "other  CE  systems  compatibility"  subtest  is  a 
listing  of  selected  CE  links  that  will  suffer  degradation,  with  a number 
indicating  the  relative  degree  of  degradation. 

2.1A.2.3  Assumptions  and  Estimation  Conditions 

None. 


This  section  provides  the  US  Army  directive  that  established  teams 
for  the  allocation  of  utility;  it  further  provides  the  consolidated  alio 
cation  that  will  be  used  in  the  INTACS  effectiveness  evaluation  for  the 
mid  range  time  frame  systems. 


\ 


S-20  February  1974 


r 


1 


ATCD-CI-E 

SUBJECT:  Measures  of  Effectiveness  (MOEs)  for  Integrated  Tactical  Commu- 

nications System  (INTACS)  Study 


Commander,  US  Army  Logistics  Center,  Ft  Lee,  Virginia  23801 

Commander,  US  Army  Combined  Arras  Combat  Development  Activity,  Ft  Leavenworth 

Kansas  66027 

Commander,  US  Army  School/Training  Center,  ATTN:  ATSO-CTD,  Ft  Gordon 

Georgia  3090S 

The  effectiveness  methodology  for  the  INTACS  Study  requires  determina- 
tion of  relative  importance  of  identified  measures  of  effectiveness  (MOEs) 
through  a hierarchical  system  of  communications  areas  and  aspects.  This 
relative  importance  is  to  be  reflected  by  the  allocation  of  quantitative 
weights  to  each  MOE.  These  weights  are  called  utiles.  The  number  of 
utiles  allocated  to  each  MOE  is  a key  input  for  the  INTACS  Study.  Enclo- 
sure 1 describes  the  allocation  process.  Enclosure  2 contains  applicable 
definitions. 

2.  In  order  to  ensure  validity,  the  allocation  of  utiles  to  MOE  must  be 
made  in  light  of  the  effect  of  the  MOEs  on  communications  in  support  of  a 
combat  situation.  Allocations  must  be  made  only  by  experienced  individuals; 
furthermore,  it  is  required  that  more  than  one  independent  allocation  of 
utiles  be  made  to  provide  depth  for  analysis  and  to  ensure  that  the 
results  represent  a balance  of  military  judgement.  Accordingly,  four 
Independent  evaluations  will  be  made  by  teams  at  the  US  Army  Combined  Arms 
Combat  Development  Activity  (USACACDA) , US  Army  Logistics  Center  (USALC), 

US  Army  Southeastern  Signal  School  (USASESS) , and  at  Headquarters,  US  Army 
Training  and  Doctrine  Command  (HQ  TRADOC).  Team  members  at  USACACDA  and 
HQ  TRADOC  will  be  combat  arms  officers  with  command  experience  at  battalion 
or  higher  level.  Teams  at  USASESS  and  USALC  will  consist  of  personnel  with 
equivalent  command  experience  within  thei£  specialties. 

3.  Team  will  be  organized  as  follows: 

a.  A minimum  of  six  voting  members,  including  the  chairman. 

b.  A chairman  of  0-6  rank  will  be  designated  for  each  team. 

c.  Each  team  will  document  its  organization  and  rules  of  procedure. 
These  rults  should  be  simple,  should  be  few  in  number,  and  should  include 
whatever  methodology  the  team  plans  to  use  to  make  its  allocation. 
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ATCD-CI-E 

SUBJECT:  Measures  of  Effectiveness 

nications  System  (INTACS) 


(MOEs)  for  Integrated  Tactical  Conmr 
Study 


4.  Procedures  for  allocating  utiles: 

a.  The  procedure  described  in  Enclosure  1 will  be  used  as  a basis  for 
allocation  of  utiles. 


b.  The  initial  allocation  will  employ  the  areas,  aspects,  and  MOEs 
defined  in  Enclosure  2.  Having  accomplished  the  initial  allocation,  each 
team  (or  member)  may  then  make  an  independent  analysis  and  allocation  based 
on  new,  changed,  or  eliminated  areas,  aspects,  and  MOEs  which  it  considers 
will  produce  a better  set  of  measures  to  evaluate  the  effectiveness  of 
communications  systems.  Every  effort  will  be  made  to  reduce  the  number 
of  areas,  aspects,  and  MOEs.  New  or  changed  areas,  aspects,  and  MOEs 

must  be  defined. 


c.  Allocations  will  be  made  on  the  basis  of  military  judgement, 
team  will  produce  a "team"  position. 

5.  The  results  arrived  at  by  each  team  will  be  published  as  follows 


Each 


a.  Allocation  of  utiles  to  the  MOEs,  as  described  in  paragraph  4b 
above,  will  use  the  format  in  Enclosure  3.  An  allocation  form  will  be 
prepared  and  submitted  for  each  team  member,  as  well  as  a form  representing 
the  views  of  the  team  as  a whole.  Each  allocation  will  be  supported  by  a 
brief  rationale. 


b The  allocation  arrived  at  by  the  team  based  on  elimination,  change, 
or  addition  of  areas,  aspects,  or  MOEs  will  be  documented  in  the  same 
manner.  Allocation  criteria,  rules  of  thumb,  or  other  aids  and  guides 
used  by  the  teams  will  be  briefly  described. 


c.  Completed  reports  documenting  team  results  (to  include  individual 
member  results)  will  be  submitted  to  HQ  TRADOC,  ATTN:  ATCD-CI-E,  by  close 
of  business  on  20  February  1974.  The  independent  results  of  each  team  will 
be  submitted.  Recommendations  and/or  comments  resulting  from  staffing  may 
be  submitted  as  an  addendum  to  the  team  report. 


6.  In  order  to  assist,  this  headquarters  is  prepared,  upon  request,  to 
provide  an  orientation  briefing  on  methodology  and  to  answer  questions  or 
the  teams  prior  to  their  allocation  effort.  Point  of  contact  for  t a 
headquarters  is  LTC  Foster,  AUT0V0N  680-3465. 
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ATCD-CI-E 

SUBJECT: 


Measures  of  Effectiveness  (MOEs)  for  Integrated  Tactical  Commu- 
nications System  (INTACS)  Study 


7.  The  results  of  the  four  independently  conducted  allocation  actions 
will  be  analyzed  and  correlated  by  this  headquarters  prior  to  presentation 
to  the  INTACS  contractor  and  the  DA  Study  Advisory  Group. 

FOR  THE  COMMANDER: 


3 Enel: 

1.  Utile  Allocation 

2.  Definitions 

3.  Utile  Format 

CF:  w/encl 

Comdt , USASESS 


Robert  c.  McAlister 

Major  General,  GS 
Deputy  Chief  of  Staff 

for  Combat  Developments 
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ENCLOSURE  1 


1.  A utile  Is  a dimensionless  quantity  used  to  weigh  the  measures  of  effec- 
tiveness (MOEs)  that  will  form  a basis  for  evaluation  of  the  alternative 
communications  systems. 

2.  The  assignment  of  utiles  to  MOEs  is  a subjective  process.  The  number 
of  utiles  assigned  to  an  MOE  designates  the  relative  importance  of  the  MOE 
when  compared  against  other  MOEs.  As  an  example,  if  MOE-1  has  been  assigned 
10  utiles  and  MOE-2  has  been  assigned  5 utiles,  this  indicates  that  MOE-1 

is  twice  as  important  as  MOE-2. 

3.  For  the  purposes  of  this  exercise,  a communications  system  is  assigned 
1000  utiles.  The  allocation  process  is  a method  by  which  this  1000  utiles 
is  divided  among  the  various  MOEs  so  that  the  number  of  utiles  assigned  to 
an  MOE  will  reflect  its  relative  contribution  to  communications  systems 
effectiveness.  The  process  is  accomplished  by  successive  assignment  of 
utiles  to  areas,  aspects,  and  finally  to  MOEs.  Distribution  of  utiles  is 
separated  into  three  stages  to  limit  the  number  of  elements  that  must  be 
considered  at  one  time.  The  first  stage  is  to  distribute  the  total  utiles 
among  the  fourteen  areas.  The  basis  for  this  allocation  is  the  relative 
importance  of  each  communications  system  area  under  consideration.  As  an 
example,  if  there  were  only  five  areas,  the  breakout  might  look  like  this: 


The  number  of  utiles  assigned  to  each  area  is  not  expected  to  be  equal,  but 
should  be  apportioned  to  each  area  in  accordance  with  its  relative  impor- 
tance. The  sum  of  the  utiles  of  all  areas  must  equal  1000. 

In  the  second  stage,  these  area  utiles  are  subdivided  and  allocated  to 
aspects  within  each  area.  If  a particular  area  has  three  aspects,  the 
breakout  of  utiles  might  look  like  this: 
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Area 


Aspects 


In  this  case,  the  total  number  of  utiles  assigned  to  the  three  aspects  equals 
the  number  assigned  to  the  parent  area  (i.e.t  250).  As  in  the  case  of  areas, 
note  that  the  sum  of  all  the  utiles  assigned  to  all  aspects  of  all  areas 
must  equal  1000. 

In  the  third  stage,  using  a similar  procedure,  the  MOE  utiles  are  derived 
from  aspect  utiles.  As  an  example,  for  an  aspect  with  three  MOEs,  the 
breakout  might  look  like  this: 


Aspect 


MOE 


The  sum  of  the  three  MOEs  assigned  to  this  aspect  will  equal  that  of  its 
parent  aspect.  As  for  areas  and  aspects,  the  sum  of  all  the  utiles  assigned 
to  all  MOEs  must  equal  1000. 

4.  Additional  procedures: 

a.  At  least  one  utile  must  be  allocated  to  each  MOE. 

b.  No  fractional  utiles  will  be  used. 

c.  After  completing  the  process,  MOEs  will  be  rank-ordered  based  on  the 
number  of  utiles  allocated.  MOEs  that  are  assigned  the  same  utile  value 
will  be  considered  to  have  equal  rank  of  relative  Importance.  If  this  rank- 
ordering  places  an  MOE  in  a relative  rank  that  is  considered  to  be  out  of 
line,  then  utiles  must  be  reallocated.  This  is  mostly  done  by  recycling 
thp  entire  process.  Therefore,  it  may  be  necessary  to  complete  several 
iterations  of  the  entire  process  in  order  to  arrive  at  an  allocation  that 
will  yield  the  rank  order  deemed  appropriate  by  the  evaluation  (or  team). 

d.  If,  after  completion  of  the  entire  process  described  above  for  the 
initial  14  areas  and  63  MOEs,  the  team  (or  an  individual)  decides  on  a dif- 
ferent (preferably  smaller)  set  of  MOEs  as  a better  measure  of  effectiveness, 
then  a similar  procedure  should  be  followed  to  allocate  utiles  and  rank-order 
the  MOE. 
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ENCLOSURE  2 


DEFINITIONS 


Area:  Electromagnetic  Compatibility  - the  ability  of  radio 

communications  equipment  to  function  in  an  operational 
environment  without  suffering  degradation  through 
mutual  interference. 


Aspect  and  MOE:  Unintentional  interference  on  a radio  from  other  radios 

within  the  system. 

Aspect  and  MOE:  Unintentional  interference  on  a radio  net  from  equip- 

ment of  other  friendly  forces  in  the  area. 


Area:  Flexibility  - the  ability  of  the  communications  system 

to  expand,  contract,  and/or  reorganize  to  satisfy  a 
variety  of  communications  requirements. 

Aspect  and  MOE:  Ability  of  the  system  to  function  in  various  operational 

environments  and  on  various  terrains. 


Aspect  and  MOE:  Ability  of  the  system  to  adapt  to  a changing  force 

structure. 


Aspect  and  MOE:  Ability  of  the  system  to  meet  a commander's  change  in 

mission. 


Aspect: 


MOE: 


MOE: 


Impact  on  system  performance  from  increasing  the  volume 
of  traffic  for  computer  systems  (data  traffic). 

System  degradation  caused  by  increased  sensitivity  to 
disturbances.  (Data  traffic  is  more  sensitive  than 
voice  to  interference.  This  could  be  caused  by  atmos- 
pheric conditions  or  enemy  Jamming,  or  it  could  be 
unintentional  interference  from  other  friendly  equip- 
ment in  the  area.  Typically,  data  traffic  would  require 
retransmissions  more  frequently  than  would  voice  traffic.) 

Quality  of  transmissions  for  data  systems  such  as  TOS 
and  TACFIRE. 


Aspect  and  MOE:  Ability  of  the  communications  system  to  accommodate 

additional  subscribers. 
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Aspect  and  MOE: 

Aspect  and  MOE: 

Aspect  and  MOE: 
Aspect  and  MOE: 

Area: 

Aspect: 

MOE: 

MOE: 

MOE: 

Aspect  and  MOE: 
Area: 


Ability  of  the  system  to  satisfy  the  c oramun ica t ions 
requirements  of  a unit  on  a special  mission. 

Total  time  of  interrupted  service  for  subscribers 
affected  by  CP  displacement. 

Ability  of  the  system  to  operate  in  varied  deployments. 

Increased  system  performance  resulting  from  using  equip- 
ment modularity. 

Logistical  Support  - the  ability  to  satisfy  support 
requirements  of  the  communications  system  in  terms  of 
power  sources,  spare  equipment,  and  spare  parts. 

Ease  of  providing  required  parts  support. 

Degree  to  which  critical  equipment  in  the  system  is  not 
operationally  ready  due  to  the  nonavailability  of  re- 
quired parts  (NORS  rate). 

Storage  requirements  to  maintain  the  necessary  spare 
parts  Inventory  in  support  of  the  communications  system. 

Ability  to  respond  to  a need  for  spare  parts.  (This 
will  be  measured  in  terms  of  stockage-levels  maintained 
and  locations  of  parts/maintenance  support  centers  with 
respect  to  the  using  units.) 

Generator  requirements  for  communications  equipment. 

Maintainability  - the  ability  to  provide  the  necessary 
maintenance  for  the  communications  system. 


Aspect:  Ease  of  providing  preventive  maintenance. 

MOE:  Total  manhours  required  to  provide  preventive  maintenance 

for  the  system. 


MOE:  Percentage  of  preventive  maintenance  that  can  be  per- 

formed without  special  test  equipment. 

MOE:  Storage  requirements  for  spare  parts  needed  for  preven- 

tive maintenance. 


MOE: 


Ease  of  providing  preventive  maintenance  measures  in 
terms  of: 


° Required  downtime  that  must  be  scheduled  for 
the  maintenance; 

# Physical  location  (remoteness)  of  deployed 
equipment . 
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Aspect: 


Ease  of  providing  corrective  maintenance. 


MOE: 

Total  manhours  required  to  provide  corrective  mainte- 
nance for  the  system. 

MOE: 

Percentage  of  corrective  maintenance  that  can  be  per- 
formed without  special  test  equipment. 

MOE: 

Storage  requirements  for  spare  parts  needed  for  correc- 
tive maintenance. 

MCE: 

Degree  to  which  equipment  is  not  operationally  ready 
and  awaiting  maintenance  (NORM  rate). 

MOE: 

Impact  of  physical  location  (remoteness)  of  deployed 
equipment  on  the  ease  of  providing  corrective  mainte- 
nance for  that  equipment. 

Aspect : 

Ease  of  maintaining  computer-assisted  parts  of  the  com- 
munications system. 

MOE: 

Manhours  and  skill  levels  required  for  normal  computer 
maintenance. 

MOE: 

Manhours  and  skill  levels  required  for  special 
maintenance. 

MOE: 

Ease  of  providing  this  computer  maintenance  measured 
in  terms  of: 

# Off-site  personnel  requirements 
0 Special  debugging  side  required. 

Area: 

Mobility  - the  ability  of  the  system  to  provide  users 
a communications  capability  during  movement. 

Aspect  and  MOE: 

Physical  setup  and  teardown  times  for  critical  equipment 
and  major  assemblages  of  equipment. 

Aspect : 

Ability  to  communicate  during  movement. 

MOE: 

Grade  of  service  during  movement. 

MOE: 

Change  in  message  quality  during  movement. 

Area: 

Operability  - the  ease  of  using  the  communications  sys- 
tem  so  that  it  adequately  serves  the  needs  of  the  user. 

Aspect: 

Degree  of  difficulty  in  system  operation. 
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MOE: 


Number  of  personnel,  by  MOS,  required  to  operate  the 
communications  system. 


MOE: 


Ease  of  placing  a telephone  call. 


Aspect  and  MOE: 
Area: 

Aspect  and  MOE: 
Aspect  and  MOE: 

Aspect  and  MOE: 
Area: 

Aspect  and  MOE: 

Aspect  and  MOE: 
Area: 

Aspect  and  MOE: 
Area: 


Service  features  such  as: 

0 Command  override 
° Conference  calls 
Abbreviated  dialing. 

Quality  of  Service  - the  ability  of  the  system  to  pro- 
vide the  user  with  successful  first-try  call  initiation 
in  a timely  manner  and  with  intelligible  message 
transmission. 

Grade  of  service  (probability  that  a telephone  or  tele- 
type message  will  not  be  blocked). 

Speed  of  service  (probability  that  a teletype  message 
will  be  received  within  the  acceptable  tie*  specified 
by  JCS  for  the  precedence  of  that  message). 

Information  quality  (probability  that  the  received  mes- 
sage will  be  intelligible). 

RF  Spectrum  Requirements  - the  number  and  width  of  radio 
frequency  channels  required  to  implement  the  operation 
of  a given  radio  system.  This  number  is  a function  of 
the  number  of  nets  to  be  formed  and  is  also  dependent 
upon  equipment  range  and  the  location  of  net  users. 

Amount  of  radio  frequency  spectrum  required  to  support 
the  operation  of  the  communications  system.  (If  the 
number  of  separate  frequency  assignments  required  within 
the  system  is  too  high,  the  frequencies  allocated  may 
be  close  to  one  another  and  interference  by  other  users 
in  the  system  will  increase.) 

Degree  of  flexibility  in  the  assignment  of  frequencies 
by  systems  managers. 

Reliability  - the  ability  of  the  system  to  have  equip- 
ment available  and  operational  when  needed. 

Availability  of  the  system  to  the  user  considering  up- 
time and  downtime  of  necessary  equipment. 

Security  - the  ability  of  the  system  to  deny  the  enemy 
the  capability  of  deriving  useful  intelligence  from 
communications  transmissions. 
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Aspect  and  MOE: 


Ability  of  the  system  to  provide  increased  secure 
comm unications . 


Aspect  and  MOE: 


Aspect  and  MOE: 


Aspect  and  MOE: 


Limitations  imposed  upon  the  system  due  to  increased 
requirements  when  security  is  provided  (e.g.,  increased 
size  and  weight  of  equipment,  additional  logistical 
support  requirements,  etc.). 

Ability  of  the  system  to  provide  the  user  with  the 
capability  of  secure  communications  with  allied  or 
interservice  forces. 

Ability  of  the  system  to  accommodate  an  increase  in 
secure  suoscrlbers. 


Aspect  and  MOE:  Ease  of  restoring  system  security  after  compromise. 

Aspect  and  MOE:  Percent  of  subscribers  provided  with  total  secure  service. 


Aspect  and  MOE: 
Area : 

Aspect  and  MOE: 
Area: 


Aspect : 


Ability  of  the  radio  net  to  avoid  enemy  interception. 

Standardization  - the  degree  to  which  the  communications 
system  uses  common,  compatible,  or  interchangeable 
equipment. 

Number  of  categories  of  communications  equipment. 

Survivability  - the  ability  of  the  system  to  function 
during  and  after  destructive  physical  and  electronic 
attack. 

Impact  of  destruction  of  communications  system  nodes. 

Network  redundancy  (number  of  nodes  that  must  be  des- 
troyed before  communications  service  drops  to  an  unac- 
ceptable level). 

Subscriber  loss  resulting  from  nodal  destruction. 

Alternate  capabilities  inherent  within  the  system  to 
minimize  the  impact  of  destruction  of  communications 
system  nodes  (e.g.,  alternate  routing  of  traffic  through 
other  nodes,  alternate  nodes  of  transmission,  etc.). 

Disruptive  impact  of  enemy  jamming. 

Transportability  - the  ease  of  transporting  communica- 
tions equipmt.it. 

Size  and  weight  of  communications  equipment,  support 
parts,  and  power  sources. 
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MOE: 


Volume  of  equipment  and  power  sources. 


MOE: 

Aspect  and  MOE: 


Aspect  and  MOE: 


Area : 


Aspect: 

MOE: 


MOE: 


MOE: 


Weight  of  equipment  and  power  sources. 

Organic  transport  capability  (i.e.,  percentage  of  the 
communications  system  that  can  be  transported  by  organic 

means) . 


Portability  of  equipment;  for  example: 


* Can  be  suspended  from  belt,  carried  in  a 
pocket,  operated  on-the-move; 

* Can  be  transported  by  one  man,  but  cannot 
be  operated  on-the-move; 

* Can  be  mounted  on  a vehicle  (such  as  a jeepy 
and  operated  on-the-move. 

Vulnerability  - the  degree  to  which  the  communications 
system  is  susceptible  to  destructive  physical  and 
electronic  attack. 


Susceptibility  to  detection  and  physical  destruction. 

Distance  of  important  nodes  from  the  enemy.  (The  actual 
measure  of  effectiveness  evaluates  the  ability  of  the 
communications  system  to  locate  a node  as  faraWa* 
the  enemy  as  possible  while  still  providing  all  services 

reauited  bv  the  users.) 


Susceptibility  of  the  communications  system  to  physical 
destruction. 


Susceptibility  of  transmitters  to  direction-finding  by 
the  enemy. 
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ENCLOSURE  3 


ALLOCATION  OF  UTILES  TO  ARIAS 

1.  Electromagnetic  compatibility  

2.  Flexibility  

3.  Logistical  support 

A.  Maintainability  .....  

5.  Mobility 

6.  Operability 

7.  Quality  of  service 

8.  RF  spectrum  requirements.  ....... 

9.  Reliability  

10.  Security 

11.  Standardization  

12.  Survivability 

13.  Transportability.  ...  

1A.  Vulnerability  
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ALLOCATION  OF  UTILES  TO  ASPECTS 


L.  Electromagnetic  compatibility 

INTACS  compatibility  

INTACS/other  system  compatibility 

2.  Flexibility 

Function  in  varying  operational  environments  . . . . 

Changes  in  force  structure  

Change  in  mission 

Varying  ratios  of  traffic 

Impact  of  added  subscribers 

System  modularity 

Downtime  for  CP  displacement  

Operation  in  varying  deployments  

Hardware  modularity 

3.  Logistical  support 

Required  parts  support  ......  

Power  requirements  

4.  Maintainability 

t 

Provision  of  preventive  maintenance 

Provision  of  corrective  maintenance 

Provision  of  software  update  
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5.  Mobil it 


Setup/ tea rdown  time 

Comnunicatlon  during  moves  . . 

6.  Operability 

Difficulty  of  system  operation  

Service  features  ......  

7.  Quality  of  service 

Grade  of  service  

Speed  of  service  

Information  quality 

8.  RF  spectrum  requirements 

RF  bandvldth  requirements 

Flexibility  of  frequency  allocation 

9.  Reliability 

System  availability 

10.  Security 

Provision  for  Increased  secure  communications.  . . . 

Limitations  due  to  Increased  security 

Ratio  of  secure  to  nonsecure  users  

Interface  security  requirements 

Restoration  after  compromise  

Degree  of  security  . 

Interceptibility  


r 


12.  Survivability 

Impact  of  nodal  destruction. 
Impact  of  jamming 

13.  Transportability 

Equipment  size  and  weight.  . 
Vehicle  requirements  . . . . 
Portability 

14.  Vulnerability 

Physical  destruction  . . . . 
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ALLOCATION  OF  UTILES  TO  MOE 


1.  Electromagnetic  compatibility 

INTACS  compatibility 

EMC/EMV  INTACS  compatibility 

INTACS/other  system  compatibility 

EMC/EMV  other  system  compatibility 

2.  Flexibility 

Function  in  varying  operational  environments 

Operational  environment  

Changes  in  force  structure 

Force  structure  

Change  in  mission 

Change  in  mission  . 

Varying  ratios  of  traffic 

Variation  of  data/voice  traffic  ratio  

Data  transmissions 

Impact  of  added  subscribers 

Additional  subscribers 

System  modularity 

System  modularity  

Downtime  for  CP  displacement 

Downtime  for  CP  displacement 
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Operation  in  varying  deployments 
Various  deployments  • • . • 


Hardware  modularity 

Hardware  modularity  

3.  Logistical  support 

Required  parts  support 

NORS  rate 

Volume  of  parts  inventory  

Ease  of  support  

Power  requirements 

Total  power  

4.  Maintainability 

Provision  of  preventive  maintenance 

Manhours  preventive  maintenance  

Maintenance  hours  without  equipment  

Volume  of  preventive  maintenance  parts.  . . . 

Ease  of  preventive  maintenance 

Provision  of  corrective  maintenance 

Manhours  corrective  maintenance  

Maintenance  hours  without  equipment  

Volume  of  corrective  maintenance  parts.  . . . 

NORM  rate  

Ease  of  corrective  maintenance 

Provision  of  software  update 

Manhours /language  - continual  

Manhours /language  - special  

Ease  of  software  maintenance 
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7.  Quality  of  service 

Grade  of  oervice 

Grade  of  service 

Speed  of  service 

Speed  of  scivice 

Information  quality 

Information  quality  ...... 

8.  RF  spectrum  requirements 

RF  bandwidth  requirements 

EMC/EMV  spectrum  requirements 
Flexibility  of  frequency  allocation 
RF  spectrum  flexibility  . . . 
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9.  Reliability 


System  availability 

System  availability  

10.  Security 

Provision  for  increased  secure  communications 

Ability  to  increase  security 

Limitations  due  to  Increased  security 

Limitations  of  increase  

Ratio  of  secure  to  nonsecure  users 

Ratio  of  secure  to  nonsecure  users 

Interface  security  requirements 

Interface  security  requirements  

Restoration  after  compromise 

Compromise  restoral  

Degree  of  security 

Number  of  subscribers  end-to-end  secure  . . . . 
Interceptibility 

Interceptibility 

11.  Standardization 

Multiplicity  of  CE  equipment 

Number  of  equipment  categories . . 

12.  Survivability 

Impact  of  nod$l  destruction 

Number  of  nodes  destroyed  to  reduce  GOS  to 
specified  level  

Subscriber  loss  due  to  nodal  destruction.  . . . 

Alternate  capabilities 
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Impact  of  Jamming 


EMC/EMV  jamming  vulnerability  

13.  Transportability 

Equipment  size  and  weight 

Volume  of  system 

Weight  of  system 

Vehicle  requirements 

Transport  vehicles  organic 

Portability 

Portability 

14.  Vulnerability 

Susceptibility  to  detection  and  physical  destruction 

Distance  of  nodes  from  the  enemy 

Susceptibility  to  physical  destruction 

Susceptibility  to  direction-finding  


DEPARTMENT  OF  THE  ARMY 
HEADQUARTERS  UNITED  STATES  AUNT  SOUTHEASTERN  SIGNAL  SCHOOL 
FORT  GORDON  GEORGIA  30105 


in  «n.r  wru  to 

ATSO-CTD-CS  8 April  1974 

SUBJECT:  Approved  Utile  Allocation  for  Task  III 


Martin-Marietta  Corporation 
ATTN:  Mr.  Rober^T  Cut  hill 

P.  O.  Box  7128  ' 

Fort  Gordon,  Georgia  30905 


r v 

APtiQClPK* 

?MT;*s  ttsntAci, 


i ^ | I ^ 

1.  Inclosed  is  the  USATRADOC  approved  allocatTOir'6'f  utiles 
for  use  in  Task  V and  for  inclusion  in  the  Task  III  Report. 

2.  The  values  assigned  to  the  various  MOE  are  not  considered 
to  be  fixed,  however,  any  changes  that  are  desired  must  be 
approved  by  the  COR  and  if  major  revisions  are  intended, 

HQ  USATRADOC  must  be  Informed. 


1 Incl 
as 


GENE  R.  FARM EL 0 
Captain,  Signal  Corps 
Contracting  Officer's  Representative 
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DEPARTMENT  OF  THE  ARMY 

HEADQUARTERS  UNITED  STATES  ARMY  TRAINING  AND  DOCTRINE  COMMAND 
FORT  MONROE.  VIRGINIA  XMK  23651 


SUBJECT:  Measures  of  Effectiveness  (HOE)  for  Integrated  Tactical 

Communications  System  (INTACS)  Study 


Commander 

US  Army  School  /Training  Center  & 
Ft  Gordon 

Fort  Gordon.  GA  30905 


Attached  as  Inclosure  1 are  TRADOC  approved  Measures  of  Effectiveness 
(MCE)  for  use  in  the  INTACS  Study. 


FOR  THE  COMMANDER 


MICHAEL  A.  RAMDALL 
MAJ,  AGC 

Aaat  AG 


ALLOCATION  OF  UTILES  TO  AREAS  AND  MOES 
— 


AREA 

MOE 

1. 

Quality  of  service 

114 

- 

a. 

Grade  of  service 

34 

b. 

Speed  of  service 

33 

c. 

Information  quality 

47 

_ 

2. 

Operability 

93 

a. 

Ease  of  placing  a call 

21 

- 

b. 

Ease  of  maintaining  a directory 

11 

c. 

Number  of  personnel 

25 

d. 

Service  features 

36 

3. 

Reliability 

129 

System  availability 

12? 

*4 

4. 

Maintainability 

84 

a. 

Manhours  preventive  maintenance 

13 

b. 

Maintenance  hours  without  equipment 

7 

c. 

Volume  of  preventive  maintenance  parts 

5 

d. 

Ease  of  preventive  maintenance 

12 

e. 

Manhours  corrective  maintenance 

6 

f. 

Maintenance  hourB  without  equipment 

5 

! 

K- 

Volume  of  corrective  maintenance  parts 

4 

h. 

NORM  rate 

9 

I 


1 


AREA 

MOE 

1. 

Ease  of  corrective  maintenance 

6 

J. 

Manhours/language  - continual 

5 

k. 

Manhours /language  - special 

5 

1. 

Ease  of  software  maintenance 

7 

5. 

Electromagnetic  compatibility 

50 

a. 

EMC/EMV  INTACS  compatibility 

32 

b. 

EMC/EMV  other  system  compatibility 

18 

6. 

Logistical  support 

79 

a. 

NORS  rate 

18 

b. 

Volume  of  parts  inventory 

8 

c. 

Ease  of  support 

12 

d. 

Total  power 

41 

7. 

Security 

71 

a. 

Ability  to  increase  security 

15 

b. 

Limitations  of  increase 

12 

c. 

Ability  of  the  system  to  expand 

8 

d. 

Interface  security  requirements 

8 

e. 

Compromise  restoral 

9 

f. 

Number  subscribers  end-to-end  secure 

8 

g- 

Interceptibility 

11 

8. 

Flexibility 

95 

a.  Operational  environment  13 

b.  Force  structure  13 

c.  Change  In  mission  12 

d.  Variation  of  data/voice  traffic  ratio  6 


AREA  MOE 


e. 

Data  transmissions 

7 

f. 

Additional  subscribers 

11 

g. 

System  modularity 

5 

h. 

Downtime  for  CP  displacement 

12 

1. 

Various  deployments 

10 

- 

j. 

Hardware  modularity 

6 

9. 

Mobility 

75 

a. 

Physical  setup/teardown  time 

38 

b. 

GOS  during  a move 

17 

c. 

Change  in  message  quality 

20 

— 

10. 

Transportability 

46 

a. 

Volume  of  system 

8 

b. 

Weight  of  system 

8 

c. 

Transport  vehicles  organic 

17 

d. 

Portability 

13 

— 

11. 

RF 

spectrum  requirements 

41 

a. 

EMC/EMV  spectrum  requirements 

22 

— 

b. 

RF  spectrum  flexibility 

19 

12. 

Standardization 

39 

Number  of  equipment  categories 

39 

- 

13. 

Survivability 

45 

a. 

Number  of  nodes  destroyed  to  reduce  GOS 
to  specified  level 

8 

b. 

Subscriber  loss  due  to  nodal  destruction 

8 

— 

c. 

Alternate  capabilities 

5 

d. 

EMC/EMV  jamming  vulnerability 

26 
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AREA 


MOE 


14. 


M 


Vulnerability 

a.  Distance  of  nodes  from  the  enemy 

b.  Susceptibility  to  physical  destruction 

c.  Susceptibility  to  direction-finding 


39 

10 

11 

18 

1000  1000 


RANK  CORRELATION  TEST  FOR  MOES 


j 

I 


The  amounc  of  correlation  between  all  possible  sets  of  paired  ranks 
was  determined  by  use  of  Spearman's  formula  for  rank  correlation.  The  MOE 
values  and  corresponding  ranks  are  shown  in  Table  1.  The  computed  values 
for  the  rank  correlation  (r)  for  each  possible  paired  combination  of  data 
submitted  by  the  four  participating  organizations  are  shown  below. 

Formula: 

6 l d2 

r “ 1 5 

n(n  -1) 

where 


d *=  difference  in  paired  ranks 
n ■ number  of  paired  ranks. 


TRADOC  vs  CACDA  r 
TRADOC  vs  LOGS  r 
TRADOC  vs  SESS  r 
CACDA  vs  LOGC  r 
CACDA  vs  SESS  r 
LOGC  vs  SESS  r 


0.609 

0.511 

0.673 

0.639 

0.767 

0.689 


Null  hypothesis:  The  paired  sets  of  rankings  are  independent. 

Alternate  hypothesis:  The  paired  sets  of  rankings  are  depen- 
dent (or  correlated).  The  critical  value  for  Alpha  - 0.01  is 
less  than  0.48. 


Conclusion:  Since  each  computed  r is  greater  than  0.48,  the 

null  hypothesis  of  independence  is  rejected  in  favor  of  the 
alternate  hypothesis  of  dependence  between  all  possible  paired 
rankings . 


TABLE  1.  MOE  ami  Ranks 


|L 


TRADOC 

Rank 

CACDA 

Rank 

LOGO 

Rank 

SESS 

Rank 

a. 

30 

9 

30 

9 

40 

5 

37 

6 

b. 

40 

7.5 

10 

32 

20 

14 

38 

5 

c. 

70 

2 

30 

9 

60 

2 

28 

8.5 

a. 

50 

4 

15 

22.5 

20 

14 

29 

7 

b. 

15 

22 

5 

48.5 

10 

34 

12 

26 

c. 

25 

11 

20 

16.5 

30 

8 

26 

10 

d. 

40 

7.5 

10 

32 

40 

5 

28 

8.5 

120 

1 

125 

1 

130 

1 

141 

1 

a. 

15 

22 

10 

32 

15 

22.5 

12 

26 

b, 

10 

31 

5 

48.5 

5 

51 

10 

33 

c. 

5 

45 

5 

48.5 

5 

51 

6 

57.5 

d. 

20 

15 

10 

32 

10 

34 

9 

39.5 
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COST  METHODOLOGY 
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This  appendix  contains  the  cost  methodology  to  be  used  to  evaluate  the 
alternatives  during  Task  V.  Section  1.0  provides  the  specific  formula, 
cost-estimating  relationships  (CERs),  or  criteria  used  to  estimate  each  cost 
element  in  the  LCC  model.  The  equations  used  to  aggregate  the  cost  elements 
into  various  categories  are  presented  in  Section  2.0,  while  the  cost  ele- 
ments are  defined  in  Section  3.0  of  this  appendix. 


1.0  LIFE-CYCLE  COST  MODEL 


Total  LCC  is  the  cost  of  ownership  from  the  day  a system/equipment 
is  conceived  to  the  day  it  is  phased  out  of  use.  Included  are  the 
R&D  cost,  the  investment  cost,  and  the  total  O&M  cost  incurred  to 
support  the  equipment  during  use.  The  total  life-cycle  cost  is  com- 
puted by  using  a series  of  simple  aggregating  equations  of  the  type 
shown  below: 

Total  LCC  = R&D  Cost 

+ Investment  Cost 

+ (Annual  0&M  Cost  x Years  Equipment  is  in  Use). 


1.1  RESEARCH  AND  DEVELOPMENT  COST 

Research  and  development  cost  includes  the  costs  for  applied  research, 
engineering  design,  analysis,  development,  and  testing  that  can  be  related 
to  a specific  communications  system.  The  effort  from  which  these  costs 
derive  usually  occurs  within  advanced  development,  engineering  development, 
and  operations  systems  development  of  the  R&D  cycle.  Elements  included  in 
R&D  costs  are  shown  in  Figure  B-l,  and  are  defined  in  Section  3.0. 

The  equipment  that  will  be  part  of  the  concepts  for  the  mid  range  time 
frame  will  typically  be  items  already  fielded  or  in  various  stages  of  devel- 
opment. For  existing  equipment,  the  R&D  cost  is  considered  sunk.,  while  that 
for  future  developments  will  be  obtained  from  actual  or  proposed  outlays. 
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RESEARCH  AND 
DEVELOPMENT 

COST 


RESEARCH  AND 
DEVELOPMENT 
COST 


1.2  INVESTMENT  COST 


Investment  cost  refers  to  those  program  costs  required  beyond  the  de- 
velopmental phase  to  introduce  into  operational  use  a new  capability;  to 
procure  initial,  additional,  or  replacement  equipment  for  operational  forces; 
or  to  provide  for  major  modifications  of  an  existing  capability.  Nonrecur- 
ring costs  refer  to  investment  costs  incurred  one  time  during  the  production 
phase,  although  they  can  recur  if  there  is  a change  in  design,  contractor, 
or  manufacturing  process.  Recurring  costs  include  production  costs  that 
recur  with  each  unit  produced,  thus  tending  to  be  subject  to  a learning 
curve  in  which  the  cost  per  unit  decreases  as  quantity  increases.  The  cost 
incurred  in  the  latter  category  terminates  with  the  satisfactory  turnover 
of  an  operationally  usable  system  to  the  using  command  or  organization. 
Elements  included  in  investment  costs  are  presented  in  Figure  B-2  and  are 
defined  in  Section  3.0  of  this  appendix. 

Figure  B-2  is  placed  at  the  end  of  this  subsection  (page  B-ll). 

The  reader  is  asked  to  fold  out  this  figure  to  conveniently  see  the  rela- 
tionships between  the  investment  cost  elements  as  he  reads  the  details  of 
each  in  succeeding  paragraphs.  The  equation  for  estimating  investment 
cost  is  as  follows: 

Total  Investment  Cost  * Nonrecurring  Investment  Cost 

+ Recurring  Investment  Cost 

where 

° Nonrecurring  Investment  Cost  = Inventory  Introduction  + 
Initial  Provisioning  + Initial  Tolling  and  Test  Equipment 
+ Instructor  Training  + Initial  Production  Facilities; 

0 Recurring  Investment  Cost  = Total  Hardware  Cost  + First 
Destination  Transportation  + Initial  Training  + Site 
Activation  + Acceptance  Testing  + Transportation  from 
First  Destination. 


Components,  operational  ready  float,  repair  cycle  float,  and  preposi- 
tioned war  reserves  are  all  covered  within  the  above  terms. 


The  specific  formulas,  CERs,  or  criteria  to  be  used  to  estimate  non- 
recurring and  recurring  investment  costs  are  detailed  in  Subsections  1.2.1 
and  1.2.2,  respectively. 


1.2.1  Nonrecurring  Investment  Cost 

The  individual  elements  of  nonrecurring  investment  cost,  as  indicated 
above,  are  calculated  by  using  the  following  formulas: 

0 Inventory  Introduction  Cost  for  New  Line  Items  = Number  of 
Parts  in  Inventory  x Appropriate  Value  from  the  following 
table  (source:  Reference  4): 
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Unit  Dollar  Value 

Introduction 

1st  Year  Costs 

Super  High  (over  $25,000) 

$680 

$1070 

High  ($10,000  - $24,999) 

$530 

$ 770 

Medium  ($2,500  - $9,999) 

$450 

$ 580 

Low  (under  $2,500) 

$430 

$ 460 

Average  Cost* 

$480 

$ 510 

* Inventory  Introduction  Cost  (for  others)  - 0 

* Initial  Provisioning  Cost  ■ 15  Percent  x Hardware  Unit  Cost 
x First- Year  Total  Build  + 10  Percent  x Hardware  Unit  Cost 
x Second-Year  Total  Build  (source:  Reference  4); 

0 Initial  Tooling  and  Test  Equipment  Cost  - To  be  estimated  on 
the  basis  of  equipment  complexity  and  guidance  provided  by  ECOM; 

* Instructor  Training  Cost  - 5 Percent  x Hardware  Unit  Cost  x 
Total  Build  (source:  Reference  16); 

0 Initial  Production  Facilities  Cost  ■ To  be  estimated  based 

on  the  nature  of  the  new  equipment  and  guidance  provided  by  ECOM. 

1.2.2  Recurring  Investment  Cost 

The  individual  elements  of  recurring  investment  cost  are  calculated 
by  using  the  following  formulas: 

0 Total  Hardware  Cost  - Hardware  Unit  Cost  x Total  Build** 

(source:  by  definition); 

* First  Destination  Transportation  Cost***  *1.5  Percent  x 
Hardware  Unit  Cost  x Total  Build  (source:  Reference  4); 

* Transportation  Cost  from  First  Destination  - (0.5  Percent 
x Hardware  Unit  Cost  x Total  Build)  + 1 Percent  x Initial 
Provisioning  Cost  (source:  Reference  34); 


* Represents  a weighted  supply  requirement  cost  per  line  item  plus  cata- 
loging and  maintenance  costs.  Use  this  number  in  the  absence  of 
specific  values. 

**  For  the  purposes  of  the  INTACS  evaluation,  total  build  is  defined  as 
the  total  of  items  to  be  procured  during  the  time  frame  under 
consideration. 


***  This  is  the  factor  presently  used  in  the  PEMA  "standard  pricing"  proce- 
dure. If  standard  prices  from  the  Army  Data  File  or  the  SB  700-20  are 
used  as  hardware  cost,  these  transportation  costs  are  already  included. 


• Initial  Training  Cost  - Number  °f  Operators  * ^ 

of  Training  x (Course  Costs/Hour  + Training  SaWHour)  + 
Number  of  Maintenarce  People  x Number  of  Weeks  of  Training 

x (Course  Costs /Week  + Training  Salary/ Week)  ; 

• Site  Activation  Cost  - 6 Percent  x Hardware  Unit  Cost  x 
Total  Build  (source:  Reference  35); 

0 Acceptance  Test  Cost  - Appropriate  Figure  from  Table  B-l 
(source:  Reference  4). 

The  total  hardware  cost  includes  all  the  hardware  built  and  required 

to  operate  the  communications  system  under  OPA  funds.  Included  are  all  the 

individual  costs  of  equipments,  vehicles,  power  sources,  peripheral  equip 

ien«  and  crypto  devices  that  are  integral  to  the  communications  system. 

tv  'n  for  each  individual  equipment  is  that  price  as  identified  in 

The  unit  cost  for  eacn  maiviauax  k 7nn_,n  __  estimated  by  analo- 

in  Figure  B-3,  the  components  of  which  are  defined  as  follows. 

0 Basic  Unit  - Equipment  under  analysis  as  produced  to  a type- 
configuration.  Included  are  all  receivers  crane- 
nitters  logic,  synthesizers,  amplifiers,  and  handsets  re- 
quired to  make  an  integral  piece  of  equipment  (with  antennas, 
power  supplies,  and  all  ancillary  or  support  pieces  separately 

identified,  if  possible). 

• Antenna (s)  - Individual  pieces  of  equipment  not  integral  to 
the  basic  unit  and  having  their  own  type  classification. 

• Power  Source  - Batteries,  generators,  and  commercial  power^ 
required  to  "operate  the  basic  equipment.  For  this  analysis, 
commercial  power  was  considered  free  of  charge. 

• Vehicle  - Vehicles  for  the  CE  equipment  that  are  100  percent 
^iiociated  with  and  used  for  transporting  the  CE  equipment. 

0 Trailer  - Cargo  trailers,  or  support  trailers  used  solely  to 
support  or  transport  CE  equipment,  antennas,  and  generators. 

• Shelter  - Housing  for  the  CE  equipment  that  is  100  percent 
associated  with  and  used  to  contain  the  equipment. 

• Air  Conditioner  - Air  conditioners  common  to  the  CE  equip- 
ment  that  areToO  percent  used  in  the  operation  of  the 
basic  unit. 

• Remotes  - Equipment  required  to  operate  the  basic  equipment 
from  a distant  location.  This  includes  all  cables. 


■ 


TABLE  B-l 

Estimated  Acceptance  Testing  Costs 


EQUIPMENT 

COST 

Radios,  Aircraft 

Airborne:  VHF , UHF , SSB 

$130,000*  ) 

Ground  Station:  UHF,  VHF,  SSB 

$122,000 

Radios,  Manpack 

$110,000 

Radios,  Mobile  or  Vehicular 

$ 80,000 

Radios,  Fixed  Station  (transmitting  and  receiving) 

$34,000  to  $73,000 

Telephone  Sets,  Automatic  and  Manual  Switchboards 

$32,000  to  $73,000 

Radios,  Terminal  Se*-s,  Relays  (tropospheric) 

$68,000  to  $202,000 

Radios,  Communications  Centrals  (repeaters) 

$242,000 

Radio  Components  (receivers,  modems,  etc.) 

$ 40,000  j 

Teletypewriter  Sets  (systems,  terminals) 

$ 65,000  ) 

Centrals,  Communications  (i.e.,  SATCOM,  data) 

$225,000 

* Includes  flight  testing. 
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• Facility/Land  - Includes  all  acquisition  of  real  estate, 
site  preparation,  and  installations  fabricated  to  provide 
an  operational  facility. 

• Crypto /Ancillary  - Equipment  not  integral  to  the  basic  unit 
and  assigned  to  the  basic  unit  to  provide  crypto  or  other 
modes  of  communication. 

0 Leasing  Costs  - Costs  for  leasing  the  lines  used  for  commu- 
nication of  any  other  facility  leased  for  the  use  of  the 
equipment. 


: 

; 


FIGURE  B-2  Investment  Cost  Breakdown 
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1. 3 OPERATION  AND  MAINTENANCE  COST 

Included  in  this  category  are  the  costs  of  personnel  and  material 
facilities,  plus  other  direct  and  indirect  costs  required  to  operate,  main- 
tain, and  support  the  equipment/system  during  the  operational  phase.  Inclu- 
ded also  is  the  cost  of  all  parts  consumed  in  maintaining  the  equipment, 
as  well  as  the  cost  of  operating  the  necessary  supply  systems  for  parts, 
components,  equipment,  and  information. 

Costs  are  to  be  estimated  on  a per-year  basis  (in  all  categories). 

For  the  purpose  of  cost  estimation,  operation  and  maintenance  (O&M)  costs 
must  be  divided  into  certain  elements  specifically  chosen  to  permit  maximum 
use  of  the  cost  data  presently  available  as  inputs  to  this  costing  effort. 
These  cost  elements  are  presented  in  Figure  B-4. 

Figure  B-4  is  located  at  the  end  of  this  subsection  (page  B-18). 

The  reader  is  asked  to  fold  out  this  figure  to  conveniently  see  the  rela- 
tionships between  the  O&M  cost  elements  as  he  reads  the  details  in  the  suc- 
ceeding paragraphs.  The  equation  used  to  estimate  O&M  cost  is  as  follows: 

Annual  O&M  Cost  = Equipment  O&M 
+ Vehicle  O&M 
+ Generator  O&M 
+ Air  Conditioner  O&M 
+ Contractor  Maintenance 
+ Transportation  Services 
+ Indirect  Operating  Costs. 

The  individual  elements  of  annual  O&M  cost,  as  indicated  above,  are 
calculated  using  the  following  formula: 

Equipment  O&M  Cost  * Pay  and  Allowances  for  Operators  + Pay  and 
Allowances  for  Maintenance  Personnel  + Replacement  Training  + 
Repair  Parts  + Integrated  Logistical  Support  + Depot  Rebuild 


where 


Pay  and  Allowances  for  Operators  * Number  of  Shifts  x Number  of 
Operators  per  Shift  x Annual  Pay  and  Allowances  (source:  Ref- 
erence 4); 

Pay  and  Allowances  for  Maintenance  Personnel  = Cost  per  Active 
Maintenance  Manhour  x Total  Maintenance  Manhour  per  Equipment 
(source:  Reference  4); 

Replacement  Training  Cost  = Annual  Turnover  Rate  x Cost  of 
Training  x Number  of  Operators  Required  (source:  Reference  4); 
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Repair  Parte  Coat  - * i'fticent  x Hardware  Unit  Coat  (source: 

Reference  4)*; 

Depot  Rebuild  Cost  ■ 0.809  (Depot  Overhaul  Rate**)  x (Hard- 
ware Unit  Cost)0,881  (aource:  Reference  4); 

Integrated  Logistical  Support  Cost  ■ Inventory  Maintenance  + 

Holding  Inventory  + Transportation  Charges  to  Overhaul; 

Inventory  Maintenance  Cost  - Amount  from  Table  B-2  (source: 
Reference  4) ; 

Inventory  Holding  Cost  ■ 17  Percent***  x Initial  Spares 
(source:  Reference  4); 

Transportation  Charges  to  Overhaul  ■ 5 Percent  x Spare  Parts 
Coat  (eource:  Reference  4); 

. Depot  Overhaul 

Vehicle  Operation  and  Maintenance  Cost  - POL  + — 12 

+ Maintenance  Personnel  + (Repair  Parts  Factor  + Replenishment 
Provisioning  Factor)  x Hardware  Unit  Coat  + Second  Destination 
Repair  Parte  Factor  x Hardware  Unit  Coat  (Table  B-3,  as  taken 
from  U.S.  Army  Tank- Automotive  Command); 

Generator  Operation  and  Maintenance  Cost  • MPA  + Overhaul  + . 

Fuel,  Lub,  Oil  + Parts  (Table  B-4,  as  taken  from  Reference  4); 

Air  Conditioner  Operation  and  Maintenance  Cost  ■ Value  from 
Table  B-5  (in  the  absence  of  specific  information)  (source: 
Reference  4) ; 

Contractor  Maintenance  Support  Cost  ” Number  of  Depots  x Con- 
tractor Manyears/Depot  x Contractor  Manyear  Salary  x 1/ (Total 
Build)  x 1/ (Number  of  Years  in  Inventory); 

Transportation  Services  Cost  - (2.52  Tons/Person/Year)  x (Cost/Ton) 
x (Number  of  0&M  Repairmen /Equipment)  (source:  Reference  29); 


* Range  of  X used  in  past  studies  has  been  5 to  20;  specific  value  of  X 
will  be  determined  on  the  basis  of  the  complexity  of  the  equipment 
Involved. 

**  If  epedflc  depot  overhaul  rate  la  not  available,  use  0.22. 

***  The  17  percent  ehown  ia  in  accordance  with  the  aource  referenced,  but  a 
Qgy  figure  of  33  percent  has  been  provided  by  ECOM.  This  new  figure 
will  be  used  on  approval  from  AMC. 
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TABLE  B-2 

Inventory  Maintenance  Cost 


Unit  Dollar  Value*  I Total  ^ine  Item  Cost** 

f (Recurring) 


Super  High  (over  $25,000) 

$720 

High  ($10,000  to  $24,999) 

$420 

Medium  ($2,500  to  $9,999) 

$130 

Low  (under  $2,500) 

$110 

Average  Cost*** 

$160 

* Hardware  line  item  cost 
**  Dollars,  rounded 

***  Weighted  supply  requirement  coat  per  line  item  plus 
cataloging  and  provisioning  coete. 


i 
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TABLE  B-4 
Generator  O&M  Cost 


Size  (kW) 
(60  Hz) 

MPA  ($) 

Overhaul  ($) 

POL  ($) 

Parts  ($) 

1.5 

90 

375 

130 

215 

3 

90 

645 

230 

215 

5 

90 

695 

360 

210 

10 

60 

550 

400 

140 

15 

75 

435 

460 

165 

TABLE  B-5 

Air  Conditioner  O&M  Cost 


Unit  Capacity 

Military,  60  Hz 

Military,  400  Hz 

6,000  BTU 

$1,200 

$1,400 

9,000  BTU 

$1,200  0 

$1,250 

j 18,000  BTU 

$1,500 

$2,400 

36,000  BTU 

$1,250 

$1,400 

60,000  BTU 

$2,800 

$2,500 

I 


0 Indirect  Operating  Cost  ■ (Cost /Man /Year)  x (Number  of  O&M 
Repairmen/ Equipment)  (source:  Reference  16)  according  to: 

Cost/Man/Year 

$780/man/year  when  stationed  in  CONUS 

$1, 480/man/year  when  stationed  overseas 

$1, 000/man/year  when  location  is  indeterminate. 

Number  of  men  is  sum  of  O&M  personnel  required  per 
year.  If  direct  O&M  costs  are  calculated  separately, 
this  cost  can  be  established  and  listed  separately 
also. 
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OPERATION  AND 
MAINTENANCE  COST 


FIGURE  B-4  Operation  and  Maintenance  Cost  Breakdown 
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2.0  TIME-ALLOCATION  COST  MODEL 


In  the  time-allocation  coat  model,  costa  will  be  calculated  for  each 
fiscal  year  by  aggregating  the  coat  elements  developed  in  determining  li  e- 
cycle  cost.  The  following  is  a list  of  time-allocation  coat  model  outputs 
required  for  budgetary  purposes: 

* Test  and  evaluation  costs 

0 Training  costs 

* Equipment  procurement  costs 

* Research  and  development  costs 

* Manpower  costs 

* Operating  costs 

* Logistical  support  costs. 

Each  of  thasa  outputs  is  an  aggregation  of  certain  life-cycle  cost 
elements,  as  shown  in  the  following  equations: 


where 


TE  ■ E (CDT,  + CTS  + DTSA  + GT  ) 
j-1  2 2 

N 

+ E (PATE,  + OTE  + ITSA.) 
j-1  J J 

TE  ■ total  test  and  evaluation  costs  (in  dollars) 

J ■ discrete  type  of  equipment  (j*l,  2,  3,  3,  ...  N) 

CDTj  • contractor  development  tests  for  equipment  type  J 

CTSj  ■ contractor  test  support  for  equipment  type  J 

DTSAj  - development  test  site  activation  for  equipment  type  J 
GTj  ■ Government  tests  for  equipment  type  J 

PATE  ■ production  acceptance  test  and  evaluation  for  equipment 
* type  j 

OTE  " operational  test  and  evaluation  for  equipment  type  j 

ITSA  - production  test  site  activation  for  equipment  type  J ; 


IT,  + E 
J k-1 


where 


TR  - total  training  costs 

" initial  training  costs  for  equipment  type  j 
" recurrln8  training  costs  for  organizational  set  k 
R ■ set  of  identical  organization*  (k-1,  2,  3,  3,  ...  M) ; 

N 

* PR  - £ (RI  + ONR.) 

J-l  J J 

where 

PR  ■ total  equipment  procurement  costs 

PIj  - recurring  investment  costs  for  equipment  type  j 

0NRj  - nonrecurring  investment  costs  for  equipment  type  j 

(excluding  initial  training  and  test  and  evaluation); 

N 

° RD  - Z ORD 
j-l  J 

where 

RD  ■ total  research  and  development  costs 

0R°j  " !e8earch  811,1  develop®ent  costs  for  equipment  type  j 
(excluding  test  and  evaluation) ; 

M 

0 MPWR  - l PER 
k-1  * 

where 

MPWR  - total  manpower  costs 

PERk  - personnel  costs  for  organizational  set  k; 

N M 

• OPC  - z 0,  + l 0, 

J-l  1 k-1  k 

where 

OPC  - total  operations  cost  (excluding  personnel) 

" operating  costs  associated  with  equipment  type  j 
°k  - operating  costs  for  organizational  set  k; 

N M 

0 LSC  - E LS.  + E IS 
j-l  J k-1  k 

where 
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Lsc  » total  logistical  support  costs  (less  personnel  and 
replacement  training) 

LS  - logistical  support  costs  associated  with  equipment 
^ type  J 

LS  - logistical  support  costs  associated  with  organizational 
k set  k. 

Each  of  the  component  elements  on  the  right-hand  side  of  the  foregoing 
equations  will  be  estimated  in  a manner  similar  to  that 
estimated  in  life-cycle  costing;  CERs,  cost  factors,  and  bidder  estimates 
will  all  be  used.  The  implementation  and  support  plans, _h°wever , wili 
Jrl  detailed  than  the  candidate  system  descriptions  of  Task 

_ -i  ._i  1 1 nroduce  more  accurate  estimates  or  is  neces 

saryf to  produce  estimates  for  lower- level  budget  activities,  a more  detailed 
estimating  procedure  should  be  used. 
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3.0  COST  ELEMENT  DEFINITIONS 


V 


\ 


3.1  RESEARCH  AND  DEVELOPMENT  COSTS 

Research  and  development  costs  refer  to  all  costs  associated  with  the 
research,  development,  test,  and  evaluation  of  the  system/equipment.  Speci- 
fically, this  covers  concept  initiation,  validation,  and  full-scale  develop- 
ment phases  of  the  program,  and  includes  costs  for: 

• Feasibility  studies 

0 Engineering  design,  development,  fabrication,  assembly,  and 
test  of  engineering  prototype  models 

0 Initial  system  evaluation 

® Associated  documentation. 

The  costs  incurred  in  this  category  terminate  with  the  satisfactory 
completion  of  the  Government's  operational  test  and  evaluation  (OTE) 
program. 

3.1.1  Advanced  Development 


3. 1.1.1  Contractor  Costs 


The  cost  of  any  concept  initiation  and  validation  work  performed 
under  contract  is  considered  in  this  element. 

3. 1.1.2  Government  Costs 


The  cost  of  any  concept  initiation  and  validation  work  performed 
by  the  Government  is  considered  in  this  element. 

3.1.2  Engineering  Development 

This  element  covers  the  costs  of  full-scale  development  associated 
with  the  equipment.  It  is  in  this  portion  of  the  R&D  phase  that  a design 
concept,  having  been  proven  in  theory,  is  engineered,  fabricated,  and 
tested.  It  typically  includes  program  management,  engineering,  fabrica- 
tion, testing,  and  associated  documentation. 


L 

r 


B-22 


3. 1.2.1  Contractor  Coats 


3. 1.2. 1.1  Program  Management 

This  element  refers  to  the  technical  and  administrative  plan- 
ning, organizing,  directing,  coordinating,  controlling,  and  approving  actions 
designed  to  accomplish  overall  program  objectives  during  the  R&D  phase  of 
the  equipment  life  cycle.  Examples  of  these  activities  are  configuration 
management,  cost/schedule  management,  data  management,  contract  management, 
liaison,  value  engineering,  quality  assurance,  and  Integrated  logistical 
support  management. 

3. 1.2. 1.2  Engineering 

This  element  includes  costs  incurred  for  the  study,  analysis, 
design,  development,  system  integration,  evaluation,  and  redesign  of  equip- 
ments. It  further  includes  direct  labor,  materials,  test  equipment,  in- 
direct services,  and  other  direct  or  indirect  costs  Incurred  during  the 
engineering  process.  The  development  of  computer  software  is  Included  as 
well  as  the  cost  of  computer  time. 

3. 1.2. 1.3  Fabrication 

I 

This  element  includes  the  cost  of  direct  labor,  materials,  tool- 
ing, and  overhead  required  to  produce  full-scale  development  models  and 
equipment  on  a limited  basis  for  testing  and  design  verification  purposes. 

3. 1.2. 1.4  Contractor  Development  Tests  (CDT) 

These  testa  are  generally  conducted  on  one  or  more  prototype 
full-scale  development  models  at  the  contractor's  facility,  to  demonstrate 
that  design  specifications  related  to  performance,  control,  maintenance, 
safety,  maintainability,  reliability,  and  human  factors  are  satisfied. 

This  element  Includes  the  cost  of  direct  labor,  materials,  overhead,  and 
other  direct  charges  required  to  perform  CDT.  It  also  Includes  the  pre- 
paration of  test  standards,  plans,  and  procedures. 

3. 1.2. 1.5  Test  Support 

This  element  includes  the  cost  Incurred  in  support  of  Government 
testing  (DT/IOTE).  It  includes  the  cost  of  site  activation,  consulting 
services,  training,  spare  parts,  maintenance,  testing,  and  transportation 
of  equipment  and  contractor  test  personnel  to  the  test  site. 

3. 1.2. 1.6  Industrial  Facilities 

This  element  includes  the  costs  of  structures  or  other  real  pro- 
perty required  during  full-scale  development.  It  further  includes  the  cost 
of  modification,  modernization,  and  alteration  of  these  facilities.  All 
direct  labor,  materials,  overhead,  and  other  direct  charges  are  included. 


U. 
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3. 1.2. 1.7  Producibillty  Engineering  and  Planning  (PEP 


| 


1 


PEP  consists  of  those  planning  and  engineering  tasks  undertaken 
during  the  development  phase  to  ensure  the  timely  and  economic  producibility 
of  a component/item  prior  to  release  for  production.  PEP  tasks  consist  of 
the  following  type  activities: 

0 Development  of  technical  data  package 

0 Design  of  special-purpose  production  equipment  and 
tooling 

a Computer  modeling/simulation 
° Engineering  drawings 

0 Engineering,  manufacturing,  and  quality-support 
information 

0 Dimensional  and  tolerance  data 
0 Manufacturing  assembly  sequences 
0 Wiring  diagrams 

0 Material  and  finishing  information 
0 Inspection,  test,  and  evaluation  requirements 
0 Calibration  information  and  quality  control  data. 

All  other  documentation  is  contained  in  the  next  subsection. 

3. 1.2. 1.8  Documentation  - 


This  element  includes  the  cost  of  preparation,  revision,  and 
reproduction  of  drawings,  specifications,  parts  lists,  plans,  procedures, 
draft  technical  manuals/orders,  and  other  documentation  produced  in  support 
of  project  management,  engineering  fabrication,  and  testing  functions.  This 
cost  element  excludes  computer  software. 

3. 1.2. 1.9  General  and  Administrative  Costs 

G&A  includes  the  expenses  of  a contractor's  general  and  execu- 
tive offices;  staff  services,  such  as  legal,  accounting,  public  relations, 
financial,  and  similar  activities;  and  other  miscellanrous  needs  related  to 
the  overall  business.  Included  are  directors'  and  executive  committee  mem- 
bers' fees,  bonuses,  and  incentive  awards;  employee  stock  options;  and  em- 
ployee fringe  benefits. 


L 
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3.1.2.1.10  Fee 


Fee  Is  that  portion  of  the  total  contract  price  that  is  allowed 
a contractor  over  and  above  the  cost  to  produce  or  perform. 

3.1.2.1.11  Other 

This  element  includes  all  costs  incurred  by  the  contractor 
during  full-scale  development  that  are  not  included  in  the  above-listed 
elements. 

3. 1.2. 2  Government  Costs 


3.1. 2.2.1  Program  Management /Support 

This  element  refers  to  technical  and  administrative  planning, 
organizing,  directing,  coordinating,  controlling,  and  approving  actions 
designed  to  accomplish  overall  program  objectives  during  the  R&D  phase  of 
the  equipment  life  cycle.  Examples  of  these  activities  are  configuration 
management,  cost/schedule  management,  data  management,  contract,  management, 
liaison,  value  engineering,  quality  assurance,  and  integrated  logistical 
support  management. 

3.1. 2. 2. 2 Test  Site  Activation 

This  element  refers  to  the  costs  incurred  to  prepare  a test 
site  for  Government  testing.  It  includes  the  cost  of  transportation  of 
equipment  and  testing  personnel  to  the  test  site.  The  cost  of  direct  labor, 
materials,  overhead,  and  other  direct  charges  is  also  included. 

3. 1.2. 2. 3 Government  Tests  (DTE/IOTE) 

The  development  test  and  evaluation  (DTE)  is  designed  to  deter- 
mine and/or  verify  technical  performance  and  safety  characteristics  of  an 
item,  associated  tools,  and  test  equipment.  It  includes  determination  of 
structural,  mechanical,  electrical,  chemical,  and  other  physical  properties 
of  the  equipment.  Initial  operational  test  and  evaluation  (IOTE)  is  that 
portion  of  operational  test  and  evaluation  performed  during  the  FSD  phase 
prior  to  a production  decision.  The  objectives  are  to  provide  information 
at  the  production  decision  point  as  to  the  system/ equipment  military  use, 
expected  operational  effectiveness,  and  operational  suitability.  This  cost 
element  includes  the  cost  of  direct  labor,  materials,  overhead,  and  other 
direct  charges  Incurred  in  the  conduct  of  DTE/IOTE.  It  also  includes  any 
Government  costs  incurred  in  preparation  of  test  requirements,  plans,  and 
procedures. 

3. 1.2. 2. A Government- Furnished  Equipment  (GFE) 

This  is  the  effective  cost  to  the  Government  of  GFE  supplied  to 
the  contractor  during  the  full-scale  development  phase  of  the  equipment 


B-25 


life  cvcle  Equipment  loaned  to  a contractor  and  later  returned  to  the 

condition  nay  re.nlt  in  zero  coat  for  thi.  element. 


3. 1.2. 2, 5 Other 

This  element  includes  the  costs  incurred  by  the  Government  during 
full-scale  development  not  covered  in  the  above  elements. 


3.2  INVESTMENT  COSTS 

Initial  investment  costs  are  one-time  outlays  (both  recurring  and  non- 
than  those  to  produce  and  deploy  an  operational  system 
T^ludldglre  the  costa  of  establishing  the  logistical  system,  tooling  and 
ust  equipment , engineering  and  management  support,  and  acceptance  testing. 

3.2.1  Nonrecurring  Investment  Costs 

3.2. 1.1  Inventory  Introduction 

-mia  element  includes  those  costs  associated  with  the  introduction 

T^entor,  „„d  replacement  rates,  and  development  of  rebuild,  requi- 
sit ion,  and  procurement  directives. 

3.2. 1.2  Initial  Provisioning  (Spares  and  Repair  Pa.r.ts). 

This  element  includes  components,  assemblies,  and  parts  to  be  pro- 
cured as  initial  stock  for  maintenance  replacement  purposes,  which  tn  y 
identlf table ^llne  ttems  in  the  procurement  contract  that  provide,  an  ini- 
tial  supply  of  repair  parts  to  fill  the  planned  pipeline. 

3. 2. 1.3  First  Destination  Transportation 

This  element  includes  the  cost  for  transportation  ^terials, 
osrts  and  components  from  the  point  of  procurement,  production,  or  test 
ing  to  the  first  destination  under  contract  from  final  assembly  or  tes 
plant.  Cost  of  packing  is  included. 


3. 2. 1.4  initial  Toolinft/Tcst  Equipment 


Tooling  includes  the  planning,  engineering,  design,  fabrication, 

1 ssembly  and  installation  of  tools  (including  modification  and  rework  of 
Wols  for  production  purposes),  assembly  of  tools,  dies,  templates,  pat- 
fori  blocks,  manufacturing  jigs,  fixtures,  master  forms  gauges 
eauioment,  load  bars,  work  platforms  (including  installation  of 
utilities  thereon),  and  test  equipment  (such  as  checkers  and  analyzers)  o 
support  the  manufacture  of  specified  equipment. 
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It  also  Includes  maintaining  tool  records,  establishing  make-or-buy 
plans  and  manufacturing  plana  on  nonrecurring  tools  and  equipment,  scheduling 
and  controlling  all  tool  orders,  and  programming  and  preparing  tapes 
for  numerically-controlled  machine  parts.  Nonrecurring  tooling  includes 
the  initial  set  of  tools  and  duplicate  tools  necessary  to  reach  rate 
production. 

3. 2. 1.5  Instructor  Training 

Nonrecurring  training  involves  only  the  training  of  service  instruc- 
tor personnel  for  a specific  system,  and  is  usually  conducted  by  the  con- 
tractor. It  includes  the  cost  of  all  devices,  supplies,  and  services  re- 
quired in  the  performance  of  such  training. 

3.2. 1.6  Initial  Production  Facilities 


This  element  provides  for  system  management  production  engineering 
prior  to  quantity  procurement,  to  facilitate  the  manufacture  of  the  pro- 
cured item.  It  Includes  the  establishment  and  operation  of  pilot  produc- 
tion lines;  the  development  of  production  data  packages,  engineering  draw- 
ings, bills  of  materials,  other  production  data,  and  factory  layouts;  the 
analysis  of  existing  specifications  and  standards;  and  the  proposal  and 
institution  of  other  studies  or  measures  that  will  represent  significant 
production  advances  and  cost  reductions.  It  also  Includes  the  engineering 
effort  required  to  study  the  availability  and  suitability  of  commercial 
items  for  military  use  prior  to  quantity  procurement.  It  does  not  Include 
engineering  conducted  for  development  of  tools  and  test  equipment. 

3.2.2  Recurring  Investment  Costs 

This  category  contains  cost  elements  that  result  from  the  size  of 
the  production  buy  or  repeat  order  for  the  production  of  a communications 
system  or  its  components. 

3. 2. 2.1  Total  Hardware 


Total  hardware  costs  include  all  the  equipment  built  and  required 
to  operate  the  communications  systm.  Included  in  this  element  are  all  the 
individual  costs  of  equipments,  vehicles,  power  sources,  peripheral  equip- 
ment, and  crypto  devices  that  are  Integral  to  the  communications  system. 
Escalation  factors  have  been  applied  to  the  cost  numbers  to  adjust  the 
prices  in  terms  of  current  dollars.  All  contractor  investment  costs  for 
startup,  tooling,  test  equipment,  engines ring/management,  etc.,  have  been 
included  and  amortized  over  the  production  quantity. 

3. 2.2. 2 Initial  Training 

This  element  includes  the  training  conducted  by  contractors,  train- 
ing centers,  service  schools,  and  mobile  training  teams  for  the  initial  crews 
and  direct  maintenance  personnel  required  to  introduce  a system  into  the 
inventory. 
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• 3.2.2. 3 Site  Activation 

This  element  will  include  all  real  estate  acquisition,  site  pre- 
paration, fabrication  of  facilities,  and  Installation  of  equipment  required 
for  the  operation  of  the  specified  system.  In  includes  administration, 
inspection,  and  supervision  of  construction  and  installation  for  all 
operational  equipment,  facilities,  utilities,  and  ground  improvements. 

3. 2. 2. 4 Transportation 

These  costs  are  associated  with  the  shipment  of  each  equipment 
and  repair  part  of  the  initial  provisioning  supply  from  a major  supply 
area. 


3.3  OPERATION  AND  MAINTENANCE  COSTS 

Operation  and  maintenance  costs  are  the  costs  of  personnel,  materiel 
facilities,  and  other  direct  and  indirect  costs  required  to  operate, 
maintain,  and  support  the  equipment/system  during  the  operational  phase. 

It  Includes  the  cost  of  all  parts  consumed  in  maintaining  the  equipment, 
as  well  as  the  costs  of  maintaining  the  necessary  supply  systems  for 
parts,  components,  equipment,  and  information. 

3.3.1  Equipment  Operation  and  Maintenance  Costs 

This  element  contains  the  cost  of  operating  and  maintaining  the 
basic  equipment  after  deployment.  Included  are  the  cost  of  crews,  repair 
parts,  logistical  support,  power  consumption,  and  overhaul.  Operation 
and  support  costs  associated  with  ancillary  and  support  equipment  are 
not  included  in  this  element. 

3. 3.1.1  Pay  and  Allowances  for  Operators 

This  element  includes  pay  and  allowances  for  the  operating  crew 
members.  The  crew  consists  of  those  assigned  as  a primary  duty  to  the 
direct  operation  of  the  communications  system. 

3. 3. 1.2  Pay  and  Allowances  for  Maintenance  Personnel 

This  element  Includes  the  costs  associated  with  direct  maintenance 
labor  at  the  organizational,  direct  support,  general  support,  and  depot 
levels  of  maintenance.  Direct  labor  maintenance  personnel  are  those  mili- 
tary and  civilian  personnel  engaged  in  the  active  repair  and  preventive 
maintenance  function.  Maintenance  includes  inspection,  adjustment,  tuning, 
alignment,  cleaning,  tool  and  equipment  preparation,  fault  location,  repair 
parts  replacement,  rebuild  and  overhual,  modifications,  recalibration,  and 
final  testing.  Cost  includes  allowances  and  replacement  training. 
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3. 3. 1.3  Replacement  Training 

This  element  includes  those  costs  of  training  an  individual  to 
qualify  as  a crew  member  or  maintenance  person  to  replace,  as  needed, 
personnel  previously  trained  for  these  positions. 

3. 3. 1.4  Repair  Parts 

This  element  covers  the  cost  of  procuring  new  repairable  parts 
that  have  been  lost  to  the  supply  system,  and  nonrepayable  parts  and  spec- 
ial tools  consumed  at  organizational  and  DS/GS  levels  of  maintenance  during 
the  repair  of  the  equiproent/system. 

3. 3. 1.5  Integrated  Logistical  Support 

This  element  includes  costs  required  to  maintain  the  inventory 
management  of  all  major  and  minor  items  of  supply  for  a communications  sys- 
tem. It  includes  the  commodity  command  organization  elements  concerned  with 
the  development  and  analysis  of  requirements  and  supply  status  data;  pre- 
paration of  materiel  planning  and  supply  control  studies;  and  determina- 
tion of  the  necessity  for  and  the  initiation  of  directive  or  authorizing 
action  for  cataloging,  procurement,  rebuild,  distribution,  or  disposal. 

Costs  of  line-item  receipt,  storage,  and  issue  at  all  levels  are  included 
in  this  element.  In  those  cases  where  more  than  one  system  benefits  from 
common  use  of  line-item  management,  costs  should  be  prorated  among  the  sup- 
ported systems. 

Integrated  logistical  support  cost  will  be  estimated  as  the  sum  for 
inventory  maintenance,  holding  inventory,  and  transportation  charges.  In- 
ventory maintenance  includes  all  recurring  costs  for  identification  and 
description  documentation;  maintenance  and  supply  cataloging;  development 
of  inventory  and  replacement  costs;  development  of  rebuild  requisition;  and 
procurement  directives.  Holding  inventory  is  the  cost  of  holding  inventory 
in  the  supply  system  for  one  year,  which  involves  the  measurement  of  re- 
sources expended  in  storage,  inventory  adjustment,  interest,  and  obsoles- 
cence. Transportation  charges  are  those  costs  associated  with  the  shipment 
of  each  line  item  from  a major  supply  area. 

3. 3. 1.6  Depot  Overhaul 

This  element  covers  the  in-house  costs  associated  with  equipment 
overhaul  estimated  as  an  annual  cost  for  each  fielded  equipment.  This  in- 
cludes labor  and  materials  cost,  and  also  a cost  for  transporting  equipment 
to  the  depot  and  returning  it  to  operational  status. 

3.3.2  Vehicle  Operation  and  Maintenance  Costs 

This  element  contains  the  cost  of  operating  and  maintaining  support 
vehicles  required  as  an  integral  part  of  the  communications  equipment. 
Included  is  POL  consumption,  repair  parts,  replenishment  provisioning, 
depot  overhaul,  and  maintenance  personnel  costs.  The  driver  or  operator 
is  considered  to  be  part  of  the  basic  operator  costs. 
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3.3.3  Generator  Operation  and  Maintenance  Costs 

This  element  contains  the  operation  and  maintenance  costs  for  engine 
generators  and  other  equipments  used  to  provide  power  for  the  tactical  com- 
munications system.  Costs  included  are  overhaul,  POL,  repair  parts,  maint- 
enance manpower,  and  MPA.  Operator  personnel  costs  are  included  in  the 
crew  cost  of  the  basic  equipment. 

3.3.4  Air  Conditioner  Operation  and  Maintenance  Costs 

This  element  contains  the  operation  and  maintenance  costs  for  air 
conditioners  common  to  tactical  communications  applications.  Costs  include 
repair  parts  and  maintenance  labor  only.  The  operating  manpower  costs  are 
Included  in  the  basic  equipment  crew  costs,  and  the  electric  power  con- 
sumed is  included  in  the  generator  operating  cost. 

3.3.5  Contractor  Maintenance  Support  Costs 

This  element  includes  the  annual  cost  of  contractor-performed  maint- 
enance to  support  a communications  system  in  the  field  for  one  year. 

3.3.6  Transportation  Services  Costs 

This  element  includes  the  transportation  of  support  tonnage  required 
per  individual  per  year. 

3.3.7  Equipment  Wearout 

This  element  includes  the  replacement  of  equipments  for  the  life 
expectancy  of  the  unit.  Equipment  that  must  be  replaced  due  to  wearout 
beyond  repair,  enemy  action,  abandonment,  pilferage,  and  other  causes  is 
Included  in  this  element  of  cost. 

3.3.8  Indirect  Operating  Costs 

This  element  is  the  prorated  share  of  the  cost  of  medical  care, 
service-wide  supply  and  logistics,  higher-command  headquarters  operation 
not  otherwise  accounted  for,  transportation,  and  other  miscellaneous  sup- 
port costs. 
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APPENDIX  D 

NETWORK  SIMULATION  AND  ANALYSIS  MODELS 


1.0  INTRODUCTION 

The  major  purpose  of  a network  model  is  to  aid  in  quantitative  evalu- 
ation^ network  alternatives.  It  accomplishes  this  objective  by  providing 
the  analyst  with  a quantitative  measure  of  the  system  s behavior. 

The  following  models  will  be  used  in  the  INTACS  evaluation: 

• CASE 

• SIMCE 

• Interference  Prediction  Model  (IPM). 
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2.0  CASE 


The  Communications  Analysis,  Simulation,  and  Evaluation  (CASE)  model 
is  a modular  package  of  41  programs.  CASE  simulates  a communications 
system  by  synthesizing  input  data  and  employing  an  event-by-event 
simulation  process.  More  specifically,  CASE  consists  of  three  principal 
parts: 

* The  preprocessor,  which  organizes  and  formats  the  input  data; 

0 The  simulator,  which  processes  messages  through  the  sized  sys- 
tem and  records  the  response  of  the  system; 

• The  postprocessor,  which  summarizes  the  data  recorded  by  the 
simulator  and  provides  certain  statistical  output. 


CASE  allocates  channels  among  three  modes  (telephone,  teletype,  and 
data),  but  simulates  only  TP  and  TTY.  Separate  simulation  runs  are  required 
for  TP  and  TTY;  competition  between  the  two  modes  is  not  considered.  Sole 
user  circuits  are  allocated  for  data,  but  transmission  of  data  is  not  simu- 
lated by  CASE. 

COMSR  input  to  CASE  identifies  field  units,  their  locations,  and  their 
traffic  requirements.  TP  and  TTY  traffic  requirements  indicate  the  unit- 
to-unit  message  rates  that  are  used  to  determine  the  frequency  of  message 
generation  for  the  call-by-call  simulation. 


At  the  beginning  of  the  simulation  run,  the  network  is  e«Pty.  The 
estimated  transient  time  is  ten  minutes  of  simulation;  then  stability  ex 
and  simulation  output  is  pertinent.  Manual  inputs  include  nodal  connectivity, 
nodal  location,  and  channel  requirements  (the  latter  two  are  provided  by 
SIMCE).  Other  manual  inputs  are  as  follows: 


0 Nodal  equipment  characteristics 
0 Communications  personnel  handling  times 
• Switchboard  parameters 
0 Patching  thresholds 

0 Node  identification  (area  or  command). 


CASE  addresses  patching,  and  does  not  allow  patching  through  command  nodes 


D-5 


r 


Traffic  routing  is  determined  by  the  transshipment  algorithm  (a  multi- 
commodity /minimum-  cost  algorithm) , unless  least-cost  routing  is  specified. 
Rerouting  is  done  by  the  least-cost  algorithm,  which  requires  manual  input 
Indicating  the  cost  of  message  flow  over  each  link. 

— 

2.1  APPLICABILITY  TO  SYSTEM  EFFECTIVENESS  EVALUATION 

CASE  provides  two  important  measures  of  system  effectiveness:  grade  of  __ 
service  (GOS)  and  speed  of  service  (SOS).  GOS  is  computed  for  TP  traffic 
by  counting  the  number  of  blocked  calls  during  the  call-by-call  simulation. 

2.1.1  Computation  of  GOS 

For  TP  traffic,  GOS  is  calculated  as  the  probability  that  a message 
is  not  blocked.  Blockage  occurs  in  any  of  the  following  instances: 

• An  operator  or  plug  is  not  available  at  one  of  the  nodes 

along  the  route;  - 

• A link  channel  is  not  available; 

• A loop  channel  is  not  available  between  the  node  of  des- 
tination and  the  unit  of  destination; 

• The  telephone  is  busy  at  the  unit  oPdestination. 


CASE  permits  rerouting  in  the  event  of  blockage  at  a node, 
blockage  occurs  (for  system  GOS)  only  if  all  reroutes  fail, 
for  the  system,  individual  nodes,  links,  and  unit-to-unit. 


In  this  instance, 
GOS  is  computed 


TTY  messages  are  not  blocked,  but  remain  in  queue  until  a connection 
is  successfully  established  for  transmission.  Therefore,  upon  termination 
of  the  simulation  phase  of  the  model,  a number  of  TTY  messages  may  still  re- 
main in  queue.  System  GOS  is  actually  the  message  completion  rate,  calculated 
by  dividing  the  total  number  of  messages  completed  by  the  total  number  of 
messages  generated.  The  message  completion  rate  is  also  provided  for  nodes 
and  units  that  originate  TTY  traffic. 


2.1.2  Computation  of  SOS 

CASE  measures  TP  delay  time  by  considering  the  following  contributing 
factors: 

• Queueing  time  at  nodes  (dependent  upon  operator  and  plug 
availability) ; 

• Time  required  by  an  operator  to  make  a switchboard  connection. 
Precedence  levels  and  preemption  for  TP  messages  are  not  handled  by  CASE. 
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CASE  measures  TTY  delay  time  by  considering  the  following  factors: 


0 Queueing  time  at  nodes  (dependent  upon  communications  center 
personnel  availability); 

0 Communications  personnel  handling  time  (message  center  clerk, 
transmitting  and  receiving  operators) ; 

* Message  tape  perforation  time; 

* Transmission  timet 

Precedence  levels  and  preemption  for  TTY  messages  are  handled  by 
CASE.  CASE  determines  the  priority  of  a message  in  the  following  manner: 

* The  percentage  of  messages  of  each  precedence  level  are  in- 
put to  CASE  (for  example,  it  may  be  determined  that  10  per- 
cent of  all  TTY  messages  generated  by  the  system  are  flash, 
15  percent  immediate,  etc.); 

° When  a message  is  generated,  for  any  needline,  during  the 
simulation,  a precedence  level  is  randomly  assigned,  based 
on  the  input  percentages  for  the  entire  system. 


2.1.3  Fading  Model 

CASE  includes  several  programs  whose  purpose  is  to  simulate  atmos- 
pheric fading.  Inputs  to  the  atmospheric  fading  model  include  transmission 
mode,  equipment  operational  parameters,  frequency,  and  distance  between 
terminals.  The  model  generates  a signal-to-noise  ratio  by  time  interval 
throughout  the  simulation  run.  For  voice  messages,  this  S/N  ratio  is  compared 
to  a go/no-go  threshold,  indicating  whether  or  not  the  circuit  is  adequate. 

For  messages  transmitted  as  pulses  or  bits,  the  S/N  ratio  yields  a bit  error 
rate  that  indicates  whether  or  not  the  transmission  is  considered  a failuie. 


2.2  SUMMARY 

Despite  its  attention  to  a large  number  of  system  characteristics,  CASE 
has  several  features  that  are  unrealistic  and  limit  its  applicability  to 
the  effectiveness  methodology.  For  example,  the  need  for  security  in  trans- 
mitting messages  is  not  addressed  in  CASE;  no  means  of  identifying  equipment 
capable  of  transmitting  securely  exists.  No  special  queue  exists  for  secure 
messages  awaiting  the  availability  of  a secure  transmission  capability. 


In  addition,  CASE  does  not  consider  the  following: 


• Data  transmission  simulation 

• Precedence  levels  for  TP 

• Preemption  for  TP 

• Terrain. 

The  CASE  model  simulates  Army  tactical  communications  whil«  ®*J;°c®tin8 
-v-^:  “ipm,  data.  The  main  v.lue.  of  CASE  to  the  INTACS  team 

are  its  measurement  of  COS,  SOS,  and  atmospheric  fading. 


3.0  SIMCE 


Simulation  - Communications-Electronics  (SIMCE)  is  a computer  simula- 
tion model  constructed  to  aid  in  the  design  and  evaluation  of  communications 
systems.  It  accomplishes  this  task  by  synthesizing  the  traffic  demands 
imposed  on  the  system,  by  sizing  the  communications  links,  and  by  provi- 
ding a measure  of  system  effectiveness. 

SIMCE  begins  by  converting  user  communication  requirements  to  erlang 
traffic  flow  between  typical  units;  the  model  then  assigns  specific  units 
to  nodes.  Connectivity  between  specific  units  is,  in  part,  determined  by 
the  command/support  relationship  between  the  units.  SIMCE  then  computes 
nodal  needline  traffic  volume.  This  Information  is  combined  with  the  rout- 
ing scheme  to  determine  the  volume  of  traffic  over  each  link  of  the  network. 


3.1  APPLICATION  TO  SYSTEM  EFFECTIVENESS  EVALUATION 

Within  certain  limitations  (which  will  be  noted  later),  the  current 
version  of  SIMCE  seems  to  have  three  primary  uses  to  the  INTACS  concept 
evaluation  program: 

* Given  unit  locations  and  needlines  and  approximate  area  nodal 
locations,  SIMCE  can  connect  units  to  nodes  and  provide  recom- 
mended nodal  locations  for  the  area  system. 

° Given  traffic  requirements  and  desired  GOS  for  area  and  com- 
mand systems,  SIMCE  will  provide  channel  requirements  for 
each  link. 

8 Given  traffic  requirements  and  link  capacities,  SIMCE  will 
provide  link  GOS. 

The  COMSR  data  base  includes  approximately  4170  specific  units  and  580  typi- 
cal units.  SIMCE  can  handle  3200  specific  units  and  420  typical  units. 

This  apparent  difficulty  poses  no  problem,  since  SIMCE  must  be  run  separate- 
ly for  area/command  systems  and  for  Theater  Army/Corps  and  below. 

3.1.1  Nodal  Relocation 


The  COMSR-provided  specific  unit  deck  gives  the  location  of  each 
specific  unit  with  interunit  traffic  requirements.  This  location  is  expres- 
sed in  terms  of  X-Y  coordinates  (in  six  digits),  and  is  the  actual  location 
of  the  unit  with  respect  to  an  arbitrarily  established  set  of  axes. 
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Task  V personnel  will  provide,  as  input  to  SIMCE,  the  approximate 
location  of  each  node  in  the  area  nodal  network.  SIMCE  assigns  each  speci- 
fic unit  to  the  nearest  node.  Based  on  unit  traffic  requires*nt8  £d  dls- 
tance  from  node,  the  model  can  relocate  the  nodes  through  an  Jteratl  e 
p“ce.s  of  minimizing  total  unit-to-node  erlang  kilometers.  The  process 
ceases  when  the  average  nodal  movement  is  below  0.001  kilometer. 

This  nodal-relocation  feature  has  just  recently  been  added  to  the 

model,  and  has  not  been  used  in  any  previous  study.  It  does  n°C  *8** 

4 4~+n  mnairidruHon  It  is  to  be  used  for  relocating  nodes  in  an  area 

nitwotk  only,  and  does  not  consider  any  interrelationships  with  the  command 
nodal  network. 

3.1.2  Channel  Reaulrementfl/GOS 

The  COMSR  data  base  indicates  message  requirement  by  communications 
mode  (voice,  teletype,  data,  fax,  video),  precedence  (routine,  priority, 
immediate,  flash,  flash  override,  realtime),  security  classification  (un- 
classified, FOUO,  confidential,  secret,  top  secret),  frequency  <™*er 
messages  per  24  hours  and  peak  hour  percentage),  and  message  length.  SIMCE 
currently  considers  voice,  teletype,  and  data  messages,  and  categorizes 
them  as  urgent  (flash  and  above)  or  routine,  and  as  secure  or  "™8®^re‘ 
Message  frequencies  are  calculated  for  the  8 busiest  hour8  f y ’ 

are  categorized  as  constant  (24  to  96  messages),  frequent  (8  to  23),  daily 
(1  to  7)7  or  infrequent  <<1).  SIMCE  assigns  a particular  value  for  each 

of  these  categories  (constant  60,  frequent  16,  da  y , n category 

however,  the  model  is  being  modified  to  accept  any  value  for  X3* * 

Message  length  is  constant  throughout  any  run  of  the  model,  ^IMCE  wi! 
accept  any  value  for  TP  holding  time  and  any  value  for  TTY  holding  time. 

If  a requirement  is  both  urgent  and  constant,  a sole  user  circuit  is 
assigned;  otherwise,  the  traffic  will  compete  on  a common  user  circuit.  The 
model  then  considers  ten  circuit  types: 

TP,  sole  user,  secure 
TP,  sole  user,  nonsecure 
TP,  common  user,  secure 
TP,  common  user,  nonsecure 
TTY,  sole  user 
TTY,  common  user 
Data,  sole  user,  secure 
Data,  sole  user,  nonsecure 
Data,  common  user,  secure 
Data,  common  user,  nonsecure. 

All  TTY  circuits  are  considered  to  be  secure. 

The  intemodal  traffic  routing  scheme  must  be  provided  mmual 
SIMCE  requires  that  all  traffic  between  a pair  of  nodes  mu8*  “J* 

same  path  (i.e.,  nc  routing  mixes  or  alternate  routing).  Typically,  the 
routing  schema  might  specify  that  traffic  must  be  routed  through  the  i 
mum  number  of  nodes,  and  when  more  than  one  minimum  path  exists,  trattic 
must  be  routed  on  the  most  direct  path  away  from  FEBA. 


O 

o 

o 
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Given  unit  and  nodal  locations,  traffic  requirements,  and  a routing 
scheme,  SIMCE  can: 

# Accept  channel  requirements  as  input  and  provide  GOS  as 
output; 

• Accept  design  GOS  as  input  and  provide  channel  requirements 
per  link  as  output. 


SIMCE  calculates  GOS  for  TTY,  TP,  and  data.  The  number  of  messages 
of  each  mode  is  first  converted  to  an  erlang  traffic  loading.  The  traffic 
and  the  link  capacities  are  then  input  to  a mathematical  formula  to  deter- 
mine GOS. 

With  link  capacities  as  input,  SIMCE  calculates  GOS  by  any  of  three 
mathematical  formulas.  Use  of  a particular  formula  depends  upon  the  ««ump- 
tion  concerning  what  happens  to  a call  should  it  be  blocked.  The  Erl  ng 
formula  will  be  used  in  INTACS;  this  formula  assumes  that  calls  are  dropped 

when  blockage  occurs. 

When  design  GOS  Is  Input,  channel  requirements j m ' calculated  In  a 
similar  manner.  No  simulation  is  actually  performed  by  ^ 

event,  four  separate  runs  are  required  for  each  concept.  SDLE  consider* 
the  command  network  separately  from  the  area  network,  and  considers  th 

Theater  Army  separately  from  Corps  and  below.  ^}%la“erre^t1^°dUCe8 
an  additional  burden  of  providing  dummy  access  points  to  represent  the 
sources/sinks  for  traffic  that  crosses  the  boundary  of  TA/Corps. 

SIMCE  does  not  consider: 


• Equipment  characteristics 
° Switching 

* Preemption 

0 Alternate  routing 
0 Alternate  modes 
0 Routing  mixes 
° Operational  environment 
0 Terrain. 


3.2  SUMMARY 


Despite  the  fact  that  SIMCE  fails  to  incorporate  some  significant  fea- 
tures of  tactical  communications  systems,  it  will  be  an  important  tool  in 
sizing  communications  systems  and  in  analyzing  system  effectiveness.  SIMCE 
will  provide  the  INTACS  team  with  refined  nodal  locations,  link  GOS,  and 
channel  requirements  for  each  link  in  the  network. 
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INTERFERENCE  PREDICTION  MODEL 


Electromagnetic  compatibility  analysis  of  an  INTACS  concept  requires  the 
use  of  the  Consol  Data  Corporation  6500  computer  at  Fort  Huachuca  Arizona, 
to  perform  the  many  repetitive  calculations  required  during  the  analysis 
Ind'to  C-cess  the  large  volume  of  data  needed  for  the  ana  ysis  Use  of  a 
computer  in  performing  such  analyses  requires  the  programming  of  a mathe 
matical  model.  The  interference  prediction  model  (IPM)  is  derive  rom  e 
for  nropaeation  path  loss,  which  is  the  decrease  in  strength  of  a 

from  its  point  of  origin  in  a transmitter 

to  its  destination  at  the  intended  receiver.  Because  this  equation  is 
equally  applicable  to  undesired  signals  (whether  from  friendly  transmitters 
o?  enely  Jammers),  it  can  be  used  to  represent  or  model  the  typical  radio 
interference  situation.  This  basic  model,  however,  cannot  operate  al  n 
in  the  performance  of  analyses.  A program  to  allow  the  use  of  the  model 
the  computer  must  include  other  programs  to  arrange  the  input  data  and  trans- 
late the  outcome  from  machine  language  to  numbers  or  words  that  can  be  unde 
stood  and  evaluated  by  the  analyst.  The  IPM  programs  are  designed  and  ar 
raneed  to  help  the  analyst  predict  how  well  INTACS  materiel  and  concepts 

will  perform  their  intended  function  when  immersed  in  the^ /^"can  be^epa- 
tional  environment.  The  computer  programs  that  comprise  the  IPM  can  be  sepa 
rated  into  three  major  sections.  These  sections,  together  with  the  input 
and  output  data,  are  shown,  in  block  diagram  form,  in  Figure  D-l. 

Despite  the  speed  and  accuracy  provided  by  a computer,  its  operation 
and  output  can  only  be  as  good  as  input  data  furnished.  B1°*k  J f 

diagram  covers  two  types  of  input  data.  One  type  consists  of  files  of 
reference  data  that  describe  equipment  characteristics  (such  as 
power  output,  antenna  spectrum  signature  data,  general  antenna  J* 
of  modulation,  etc.)  that  are  modified  only  when  measurement  data  indicate 

need  forUv^siL.  Other  data  are  defined  by  the  problem  to  be  analyzed. 
First  among  these  are  the  deployment  data,  which  are  derived  from  a test 
l.j  „j  consist  of  a list  of  equipments,  transmitters,  and  receiver 
gether^with* their  locations , all  "defined  by  a specified  tactical  situation. 
Other  data  which  are  defined  neither  by  the  equipment  portrayed  nor  by  the 
test  bed  Include  propagation  and  terrain  statistics  (which  contribute  to 
^ out^ml  »f  path  loas  calculations)  and  data  which  control  the  site  of 

samples  to  be  taken. 

Block  2 (the  first  section  of  the  IPM  proper)  carries  out  all  P«li- 
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test  bed  data,  including  the  technical  characteristics  and  geographical 
locations  of  all  deployed  CE  equipments.  These  are  sorted  by  frequency, 
geographical  area,  type  of  equipment,  and  organization,  and  by  other  groups 
specified  by  the  experimental  design.  Information  provided  in  the  scenario 
or  included  in  publisher  doctrine  is  used  to  assign  duty  cycles  and  impor- 
tance weights.  Based  cn  the  accuracy  or  statistical  confidence  desired  in 
the  final  determinations  of  system  effectiveness  or  equipment  performance, 
camples  of  large  groups  are  selected. 

Block  3 contains  the  interference  identification  programs,  which  cal- 
culate estimates  of  the  levels  and  types  of  signals  and  interference  at  the 
RF  input  terminals  of  each  receiver  included  in  the  previously  selected 
sample.  It  is  here  that  the  fundamental  model  (the  propagation  path  loss 
equation)  is  used.  The  equations  used  are  designed  to  include  antenna  gain, 
output  power,  types  of  terrain,  frequency,  time  of  day,  season,  and  year. 
Culling  routines  are  used  to  prevent  lengthy  calculations  for  transmitters 
that  can  be  determined  to  have  signals  at  or  below  the  receiver  threshold. 
The  variability  of  signal  strength  (i.e..  its  variance)  is  determined  for 
each  effective  signal. 

Block  4 represents  programs  designed  to  calculate  several  different 
types  of  performance  scores.  The  scores  calculated  first  are  probability 
of  satisfactory  operation  (P(SO))  for  each  of  the  sampled  CE  links  (trans- 
mitter-receiver paths).  These  scores  are  based  on  the  RF  levels  of  de- 
sired and  undesired  signals  at  the  input  of  each  receiver,  compared  to 
performance  thresholds  (scoring  data)  defined  for  each  possible  receiver- 
transmitter-interferer  combination.  P(SO)  scores  are  provided  for  the 
clear-channel  situation  (the  communicability  score),  for  the  same  channel 
with  interferers  considered  (the  compatibility  score),  and  for  each  inter- 
ferer  (the  conditional  compatiblity  score).  If  the  interferer  is  a jammer 
and  the  receiver  scored  is  its  intended  target,  the  compatibility  score  is 
a vulnerability  score.  These  scores  can  be  combined  in  weighted  averages 
to  determine  the  performance  of  whole  classes  of  CE  equipment  into  what- 
ever grouping  is  desired  for  analysis  purposes. 

Block  5 shows  the  IPM  output.  This  output  can  take  several  forms, 
depending  on  the  type  and  detail  of  the  analysis  desired.  If  it  is  desired 
to  investigate  in  detail  all  the  factors  involved  in  a small  problem,  a 
complete  printout  of  all  calculations  made  in  the  IPM  can  be  provided.  For 
large-scale  deployments,  however,  the  factors  to  be  analyzed  are  selected 
beforehand  (based  on  the  objectives  to  be  met),  and  the  computer  sorts  the 
outcomes  of  various  scoring  actions,  making  weighted  averages  and  consoli- 
dating the  output  so  that  the  overall  picture  is  visible  to  the  analyst. 
Various  statistics  can  be  prepared  to  show  the  Influence  of  factors  such 
as  path  length,  the  presence  of  own  forces,  and  effect  of  opposing  forces' 
CE,  or  the  success  of  enemy  jamming. 
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4.1  BACKGROUND 


■Hie  U.S.  Army  Electronic  Proving  Ground  (USAEPG)  has  been  tasked  to 
plan  an  electromagnetic  compatibility  and  vulnerability  (EMC/EMV)  analysis 
of  baseline  and  other  candidate  rommunications-electronics  concepts  for 
Phase  II  (mid  range  time  frame)  of  INTACS.  Tasking  was  designated  through 
the  U.S.  Army  Materiel  Command  (AMC)  and  the  U.S.  Army  Test  and  Evaluation 
Command  (TECOM)  under  AR  11-13.  Concurrently,  the  U.S.  Army  Communications- 
Electronics  Computer  Applications  Agency,  later  absorbed  as  a part  of  the 
U.S.  Army  Management  Systems  Support  Agency  (USAMSSA) , was  tasked  to  deve- 
lop test  beds  for  EMC  analysis  of  the  baseline  and  candidate  concepts. 


4.2  TEST  BEDS 

The  test  beds  are  computer  simulations  of  the  CE  environment  created 
by  an  Army  in  the  Field  force  model  opposing  appropriate  enemy  forces  in 
Europe  in  the  1976  to  1986  time  period.  The  force  model  is  designed  on 
the  CONAF  organizational  concept,  as  modified  by  the  Echelons  Above  Divi- 
sion (EAD)  reorganization.  The  baseline  test  bed  simulates  the  technical  __ 

and  geographic  relationship  among  all  electromagnetic  emitting  and  receiving 
devices  required  to  support  friendly  and  enemy  forces  at  the  time  described 
by  an  appropriate  scenario.  Such  a test  bed  creates  an  operational  en- 
vironment which  simulates  the  potential  EMC/EMV  conditions  that  could  occur 
in  a future  combat  environment. 

The  test  bed  is  constructed  and  presented  on  a series  of  computer- 
derived  magnetic  tapes,  listings,  and  other  documentation.  The  technical 
characteristics;  geographic  coordinates;  net,  equipment,  and  operator 
names;  and  other  appropriate  computer  processing  numbers,  codes,  and  iden-  __ 
tifiers  are  written  into  the  principal  tape  — the  Deployment  Data  File. 
Individual  emitter  and  receiver  records  are  assembled  on  this  tape  in  a 
predetermined  sequence  of  friendly  and  enemy  nets  and  equipment  for  ease 
in  processing. 

CE  equipments  are  deployed  in  accordance  with  the  organizational* 
doctrinal,  and  equipment  concept  for  the  baseline  INTACS  concept.  Deployed  __ 
CE  equipments  are  given  specific  assignments  of  frequency,  power  output, 
antenna  design,  and  netting  structure.  The  same  deployment  of  friendly 
and  enemy  forces  is  used  for  the  preparation  of  the  candidate  CE  concept 
simulations.  Equipments,  nets,  or  systems  are  added,  deleted,  or  changed 
from  the  baseline  test  bed,  in  accordance  with  changes  required  by  the 
candidate  concepts. 


4.3  FACTORS 

Six  factors  are  applied  to  refine  the  force  model  for  use  by  the  com- 
puter models.  These  factors  are  described  as  follows: 
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0 Cull  distance  - Minimum  and  maximum  cull  distances  are  those 
distances  within  or  beyond  which  radio  communications  are 
not  required  and  should  not  be  attempted; 

° Link  weight  - A numerical  factor  that  indicates  the  relative 
probability  of  the  transmission  of  important  traffic  over  that 
link  with  respect  to  all  other  links  possible  in  that  net; 

• Net  weight  - A nunmrical  factor  that  reflects  the  relative 
importance  of  a net  type  to  the  overall  accomplishment  of  the 
force  mission; 

• Posture  - A numerical  value  that  reflects  a unit's  or  net's 
relative  degree  of  combat-related  activity; 

• Duty  cycle  - The  percentage  of  time  that  some  link  in  a net  is 
on  the  air  (i.e.,  that  some  transmitter  is  being  used); 

• Intelligence  value  - A numerical  factor  that  ranks  the  nets  in 
a force  model  simulation  according  to  their  projected  intel- 
ligence value  to  the  enemy. 


4.4  PROGRAMS 

The  1PM  is  comprised  of  a series  of  computer  programs  designed  to 
process  a Deployment  Data  File  (a  simulated  CE  environment)  to  obtain  a 
quantitative  estimate  of  the  communicability,  compatibility,  and  vulnera- 
bility probabilities  of  CE  links,  nets,  or  systems  in  an  operational 
environment . 

This  series  of  computer  programs  is  organized  into  five  principal 
sections : 

° Preliminary  data  processing 

° Link  formation  and  selection 

• Probability  scoring 

• Interference  identification 

• System  effectiveness. 


4.4.1  Preliminary  Data  Processing 

Preliminary  data  processing  is  required  to  compare  a new  test  bed 
with  existing  EMETF  data  files.  The  EMETF  develops  new  data  to  update  net 
and  link  weighting  factors,  equipment  scoring  data,  and  analysis  design 
codes  in  accordance  with  any  new  organizational  doctrine  or  equipment  in 
the  test  bed.  The  factors  delineated  in  paragraph  4.3  are  updated  on  a 
new  magnetic  tape  called  a Military  Values  Master  File.  Equipment  codes 


D-17 


are  assigned  to  any  new  equipment  and  antenna  types,  and  appropriate  data 
are  added  to  an  equipment  scoring  matrix.  Appropriate  net,  equipment,  or 
other  analysis  category  codes  are  assigned,  based  on  the  analysis  plan. 

The  codes  facilitate  presentation  of  the  output  of  system  effectiveness 
(SE)  scores  in  the  proper  array  for  ease  of  evaluation  and  comparison. 

The  confidence  level  and  the  accuracy  desired  within  the  limits  of 
analysis  time  constraints  are  also  assigned  at  this  time,  to  control  the 
number  of  links  to  be  sampled. 

‘♦.A. 2 Link  Formation  and  Selection 

Within  the  design  of  the  analysis,  various  elements  of  the  environ- 
ment can  be  selected  for  processing.  This  selection  can  be  made  by  a 
major  organization,  division,  or  corps,  or  by  an  entire  Army  in  the  Field. 
Selection  can  also  be  made  by  frequency  band  (for  example,  only  SHF  tropo- 
scatter  multichannel  systems),  various  combinations  of  friendly  and  enemy 
CE  and  electronic  warfare  (EW)  systems,  or  other  categories  of  foreground 
and  background  environment. 

All  CE  nets  of  interest  in  the  test  bed  are  reviewed  in  the  process 
link  formation,  and  all  links  not  eliminated  by  minimum  or  maximum  cull 
distances  and  by  a zero  link  weight  are  formed.  The  net  weight,  the  pos- 
ture factor,  and  the  link  weight  of  each  link  formed  are  multiplied  by  the 
computer.  A link  value  for  each  link  with  respect  to  all  other  links 
formed  is  assigned.  This  value  indicates  both  the  relative  Importance  of 
the  link  and  also  the  probability  that  that  link  will  be  active  in  the  en- 
vironment at  the  time  being  simulated. 

links  formed  simulate  the  electromagnetic  environment  created 
by  the  tactical  situation  involved.  This  is  a function  of  the  relative 
importance  of  the  net  (net  weight)  to  the  mission  of  the  force,  as  quali- 
fied by  the  relative  combat  activity  in  the  unit  being  supported  (posture 
factor)  and  the  probability  of  a link  being  in  use  and  carrying  important 
traffic  (link  weight). 

A. A. 3 Link  Sampling 

Sufficient  links  are  sampled  (from  among  those  formed)  to  obtain  a 
final  score  that  is  within  the  confidence  level  and  accuracy  requirement 
desired.  Links  are  assembled  within  various  subgroups  or  cells,  typical 
cells  are  defined  by  such  classifications  as  net,  net  type,  or  equipment 
class.  The  total  number  of  links  sampled  is  the  aggregate  of  those  re- 
quired within  all  cells.  Sampling  within  any  cell  is  weighted  by  the  link 
, values.  The  link  sample  favors  the  most  important  links  in  the  most  impor- 
tant nets  with  the  highest  degree  of  combat  activity.  Thus,  the  links 
(transmitter  and  receiver)  with  the  highest  probability  of  being  active 
are  sampled  most  heavily,  and  the  most  realistic  electromagnetic  environ- 
ment is  created. 


» 


4.4.4  Interferer  Identification 


Each  friendly  and  enemy  ^J^ch  transmitter0"™ 

tlal  interferer.  The  duty  eye  e o eran8mitter8  according  to  link 

operates  1.  divided  among  *«  transmission  Is  established. 

Endf*  transmit  ter  SVnHrfd  In  a potential  interferer  file  for  use  in  pro- 
bability  scoring. 

4.4.5  Probability  Scoring 

. j fir..  the  absence  of  interference.  The  probabi- 
Links  are  score  t (P (s0) ) , or  probability  of  successful  infor- 

litv  of  successful  operation  //t  F .Mr.tnr  Sienals  are  modeled 

nation  transfer.  Is  measured  from  •»««  “ ter- 

from  the  output  of  the  fl  1 f r EHETF  use)  and  the  antenna  models, 

rain  propagation  model  (as  modified  for  EKETtu^  dsslred  signals  are 

to  the  receiver  Input.  to  obtain  the  P(SO)  scores, 

combined  with  empirically  reflection  of  the  probability  that  the 

distance  »d  propagation  conditions 

simulated  will  result  in  successful  communications. 

The  degradation  of  this  link 

by  a calculation  of  degradation  cause  including  a consideration  of  un- 
by  intentional  lnt«fc”“*  ^erfering  equipments,  both  friendly  and 
“.rained  t5pe?  - other  categories  of 

interest. 

Xnterceptlbiilty^and  O^*^oobablllty  of  successful^direction-flnding 

b^h1rt^1pr«^«b:nT"efr.nc,e  of  background  interference. 

4.4.6  System  Effectiveness 

v f jiccrotP  cf  links  and  the  measured  degradation 

The  P(SO)  score  of  discrete  CE  linK  t0  obtain  an  indi- 

of  thooe  links  by  an  individual  t h enVironment.  Performance 

cation  of  CE  performance  or  ^^“^^SiStion,  or  an  entire  CE 

within  a net,  a net  type,  an  equjj“"  * a * of  the  P(SO)  of  the  sampled 

system  can  be  obtained  from  a weight  J average  is  called  the  system 

links  in  a desired  category.  s^!l  *f  large  number  of  links  from  a 

effectiveness  (SE)  score.  ^ SJ\  broad  equipment  classification) 

test  bed  (i.e.,  the  entire  test  bed  or  a hroad^equip  ^ ^ yery  large 

l8J;e8S  ofihe  links  "contain0  a mixture  of  equipment,  frequency  use,  CE 

requirements^6  tactlcai°dl8positions , orgaclratlo^  and  u^cc  on.. 

mixture  tends  to  obscure  the  performance^f ^^h,  ef£ec- 

”v«nrSya«t°“dvHls  ^“effectiveness  of  particular  battalion  commend 
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nets  in  particular  areas  of  the  environment.  SE  by  net  reveals  the  EMC/EMV 
problems  that  can  develop  in  discrete  nets,  and  is  most  useful  in  the  evalu- 
ation of  competing  CE  systems. 

SE  scores  are  obtained  for  each  net  type  in  the  INTACS  baseline  and 
candidate  concepts.  The  scores  are  assembled  by  major  organization  (echelon) 
for  ease  in  evaluation  and  comparison.  SE  scores  are  also  obtained  for 
each  net  (in  a net  type)  that  obtains  a poor  communicability  or  compatlbi- 
lity  score,  or  that  is  vulnerable  to  jamming,  intercept,  or  direction- finding. 
The  P(SO)  scores  for  the  links  within  those  nets  that  have  poor  performance 
or  that  are  vulnerable  assist  in  determining  the  cause  of  poor  performance, 
the  source  of  interference,  and  the  cause  of  EW  vulnerability.  SE  scores 
for  multichannel  systems  are  obtained  by  echelon,  by  net  type,  and  by  equip- 
ment type.  The  equipment  type  category  is  used  to  facilitate  comparison 
between  line-of-sight  (LOS),  troposcatter,  down-the-hill  radio  relay,  and 
satellite  communications  systems. 


4.5  SUPPLEMENTARY  ANALYSIS 

The  EMETF  uses  other  analysis  techniques  in  addition  to  P(SO)  and  SE 
scoring  of  selected  nets  and  net  types.  A frequency  and  distance  separa- 
tion analysis  can  be  performed  on  selected  cosited,  high-frequency,  LOS, 
and  troposcatter  multichannel  systems  in  the  test  bed.  Consideration  is 
given  to  potential  harmonic  and  image  frequency  problems,  as  well  as  trans- 
receive  separation  criteria.  An  assessment  of  the  advantages  and  dis- 
advantages of  radio  frequency  requirements  of  competing  concepts  is  made. 

A system  performance  analysis  of  adaptive  systems,  such  as  MARTS,  is  also 
performed. 


} 
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APPENDIX  E 

SAMPLE  COMMUNICATIONS  SYSTEM  EVALUATION 


in  the  following  examples,  two  fictitious  ^TlTeHellZn^s 
and  Y)  are  evaluated  to  demonstrate  the  use^of  detail  t0 

methodology.  The  analys  s s n ou  ^er  possible,  the  repetition 

- - .*«  .« 

clarity,  cost  and  risk  are  not  considered. 


1.0  ALLOCATION  OF  UTILITY 

, ai  inratlon  was  the  value  of  improvement 

The  criteria  used  for  utility  total  utility  of  1000  utiles 

in  the  effectiveness  of  the  present  system  aLng  the  areaa, 

„ss  selected  £ot  Hex™  th(!  area  utilities  were  subdivided  into 

aapect#utllitiesT(Table  M)  Finally  each  sspect^ss 

ngurrE-^'^Ifls  ^t’intenden^be  the  allocation  used  in  Task  V,  but 
merely  a vehicle  to  P^lde  a quantitative  e««ple. 


2.0  evaluation  of  the  systems 

once  the  allocation 

ated  to  determine  uhat  portion  of  the  « l l'  “t  /ll  t teB  ^d  is 

•me  system  under  consideration  is  relatlvttoth.  baseline, 

assigned  a utility  value  bMed  “"  performance ^relatlve^t  ^ ^ ba8elln. 

which  has  a utility  of  zero.  value  Parameter  and  baseline  values 

requirements  have  a negative  util  Y * Parameter  values  that  corres- 

fo?  the  examples  are  presented  In J^le  E-4.  paramcters 

pond  with  maximum  utility  are  shown  in  the  same  table, 
were  reduced  to  a two-digit  number,  for  convenience. 

The  evaluation  process  is  illustrated  in  F^“r*®1^y!”o-parameter 
the  grade  of  serviceevaluation  n Figure  Z2^  h^  ^ alternative  is 

relationship  is  "°nli"*a*;  °°  a^  parameters  are  essentially  nonlinear; 
based  on  judgement.  In  fact,  ail  P may  be  judged  a reason- 

however,  with  some  of  these  a] ^ «1.« may^O  t ^ 

able  approximation.  ex  rap  . e utnity  increases  by  2 utiles. 

This 6 type  ^f' « la t ^ship's  obvious*  preferred,  and  will  be  used  when 
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TABLE 
Allocetion  of  1 


Area 

Quality  of  Service 

Mobility 

Transportability 

Vulnerability 

Survivability 

Flexibility 

Reliability 

Logistical  Support 

Security 

Operability 

Standardization 

Maintainability 

RF  Spectrum  Requirements 

Electromagnetic  Compatibility 


TABLE  E-2 

Allocation  of  Utility  to  Aspects 


Areas  and  Aspects 


Utility 


1.  quality  of  Service 


1.1  Grade  of  service 

1.2  Speed  of  service 

1.3  Information  quality 


2.  Mobility 


6.2 

6.3 

6.4 

6.5 

6.6 

6.7 

6.8 

6.9 


i 

environments 
Changes  in  force  structure 
Change  of  mission 
Varying  ratios  of  traffic 
Impact  of  added  subscribers 
System  modularity 
Downtime  for  CP  displacement 
Operation  in  varying  deployments 
Hardware  modularity 


7.  Reliability 

7.1  System  availability 
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110 

80 

70 


2.1  Setup/teardown  time 

2.2  Communication  during  moves 

40 

60 

3. 

Transportability 

3.1  Equipment  size  and  weight 

3.2  Vehicle  requirements 

70 

20 

20 

3.3  Portability 

4. 

Vulnerability 

4.1  Physical  destruction 

4.2  Susceptibility  to  direction-finding 

30 

60 

5. 

Survivability 

5.1  Impact  of  node  destruction 

5.2  Impact  of  jamming 

15 

25 

6. 

Flexibility 

6.1  Function  in  varying  operational 

15 

6 

5 

2 

2 

5 

10 

12 

3 


70 


r 


TABLE  E-2 
(continued) 


Areas  and  Aspects  

8.  Logistical  Support 

8.1  Required  parts  support  20 

8.2  Power  requirements  30 


9.  Security 

9.1  Provision  for  increased  secure 
communications 

9.2  Limitations  due  to  increased  security 

9.3  Ratio  of  secure-to-nonsecure  users 

9.4  Interface  security  requirements 

9.5  Restoration  after  compromise 

9.6  Degree  of  security 

9.7  Interceptibility 


4 

3 

10 

3 

15 

30 

25 


10.  Operability 

10.1  Difficulty  of  system  operation 

10.2  Service  features 


11.  Standardization 

11.1  Multiplicity  of  CE  equipment 


12.  Maintainability 

12.1  Provision  of  preventive  maintenance 

12.2  Provision  of  corrective  maintenance 

12.3  Provision  of  software  update 


13.  RF  Spectrum  Requirements 

13.1  RF  bandwidth  requirements 

13.2  Flexibility  of  frequency  allocation 

14.  Electromagnetic  Compatibility 

14.1  INTACS  compatibility 

14.2  INTACS/other  system  compatibility 


1000  utiles 


TABLE  E-3 

Allocation  of  Utility  to  MOEs 


1.1.1  Grade  of  service 

1.2.1  Speed  of  service 

1.3.1  System  communicability  score 

2.1.1  Physical  setup/teardown  time 

2.2.1  Percent  GOS  reduction  during  a move 

2.2.2  Information  intelligibility 

3.1.1  Volume  of  system 

3.1.2  Weight  of  system 

3.2.1  Percent  transport  vehicles  organic 

3.3.1  Portability* 

A. 1.1  FEBA  centroid  function 

A. 1.2  Susceptibility  to  destruction* 

A. 2.1  EMC/EMV  direction-finding 

5.1.1  Number  of  nodes  destroyed  to  reduce 
GOS  to  specified  level 

5.1.2  Subscriber  loss  - node  destruction 

5.1.3  Alternate  capabilities* 

5.2.1  EMC/EMV  jamming  vulnerability 

6.1.1  Operational  environment* 

6.2.1  Force  structure* 

6.3.1  Change  in  mission 

6.A.1  Variation  of  data/voice  traffic  ratio 
6. A. 2 Data  transmission* 

6.5.1  Addition  of  subscribers* 

6.6.1  System  modularity* 

6.7.1  Downtime  for  CP  displacement 

6.8.1  Various  deployments* 

6.9.1  Hardware  modularity* 

7.1.1  Percent  system  availability 

8.1.1  NORS  rate 

8.1.2  Volume  of  parts  inventory 

8.1.3  Ease  of  support* 

8.2.1  Total  power 


70 


* Qualitative  MOE 
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TABLE  E-3 
(continued) 


MOE 

Utility 

s 9.1.1 

Ability  to  increase  security* 

4 

9.2.1 

Limitations  of  increase* 

3 

9.3.1 

Ratio  of  secure-to-nonsecure* 

10 

9.4.1 

Interface  security  requirements* 

3 

9.5.1 

Compromise  restoral* 

15 

9.6.1 

Number  subscribers  end-to-end  secure 

15 

j 9.6.2 

Number  subscribers  link  secure 

10 

9.6.3 

Percent  subscribers  not  end-to-end 
that  can  be  upgraded 

5 

[:  9.7.1 

EMC/EMV  intercept 

25 

10.1.1 

Number  of  directory  listings 

3 

10.1.2 

Number  of  directory  users 

1 

10. 1.  3 

Number  of  personnel 

1 

10.1.4 

Complexity  of  system* 

5 

10.2.1 

Service  features* 

10 

11.1.1 

Number  of  equipment  categories 

10 

12.1.1 

Manhours  preventive  maintenance 

8 

12.1.2 

Percent  maintenance  hours  v/o  equipment 

2 

12.1.3 

Volume  of  preventive  maintenance  parts 

2 

12.1.4 

Ease  of  preventive  maintenance* 

3 

12.2.1 

Manhours  of  corrective  maintenance 

5 

12.2.2 

Percent  maintenance  hours  w/o  equipment 

2 

12.2.3 

Volume  of  corrective  maintenance  parts 

2 

12.2.4 

NORM  rate 

8 

12.2.5 

Ease  of  corrective  maintenance* 

3 

12.3.1 

Manhours /language  - continual 

1 

12.3.2 

Manhours/language  - special 

1 

12.3.3 

Ease  of  software  maintenance* 

3 

13.1.1 

EMC/EMV  spectrum  requirements 

10 

13.2.1 

RF  spectrum  flexibility* 

20 

! 14.1.1 

EMC/EMV  INTACS  compatibility 

15 

14.2.1  EMC/EMV  INTACS/other  system  compatibility  15 

1000  utiles 

* Qualitative  MOE 
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MOE 


1.1.1  Grade  of  service 

1.2.1  Speed  of  service 

1.3.1  System  communicability  score 

2.1.1  Physical  setup/ teardown  time 

2.2.1  Percent  COS  reduction  during 
a move 

2.2.2  Information  intelligibility* 

3.1.1  Volume  of  system 

3.1.2  Weight  of  system 

3.2.1  Percent  transport  vehicles 
organic 

3.3.1  Portability* 

4.1.1  FEBA  centroid  function 

4.1.2  Susceptibility  to  deatruction* 
4.2.1  F.MC/EMV  direction-finding 


5.1.1 

5.1.2 

5.1.3 
5.2.1 


6.1, 

6.2 

6.3 

6.4 

6.4 

6.5 

6.6 

6.7 

6.8 

6.9 


Number  of  nodes  destroyed  to 
reduce  COS  to  specified  level 
Subscriber  loss  due  to  nodal 
destruction 

Alternate  capabilities* 
EMC/F.MV  lamming  vulnerability 

Operational  environment* 

Force  structure 
Change  in  mission 
Variation  of  dats/volce 
traffic  ratio 
Data  transmission* 

Addition  of  subscribers* 
System  modularity* 

Downtime  for  CP  displacement 
Various  deployments* 

Hardware  mo)  ’ arity* 


Maximum 

Utility 


7.1.1  Percent  cy  .tern  availability 

8.1.1  NORS  rate 

8.1.2  lurae  of  parts  inventory 

8.1.3  Ease  sf  support* 

8.2.1  Total  power 


9.1.1  Ability  to  increase  security* 

9.2.1  Limitations  of  increase* 

9.3.1  Ratio  of  securs-to-nonsecure* 

9.4.1  Interface  security  requirements* 

9.5.1  Compromise  restoral* 

* Qualitative  MOE 


110 

80 

70 

40 

45 

15 

30 

40 

20 


20 

15 

15 

60 

6 

6 

3 

25 

15 

6 

5 

1 

1 

2 

5 

10 

12 

3 

70 

10 

5 

5 

30 

4 

3 

10 

3 

15 


Maximum 

utility 

Parameter 

Value 

Utility 

Value 

1 cl  t nIC  L"  l 

Value 

X 

Y Baseline 

X 

Y 

1.00 

.97 

.95 

68 

95 

84 

1.00 

.98 

.73 

.42 

77 

41 

95 

86 

62 

51 

64 

26 

1 

12 

7 

14 

9 

34 

15 

26 

31 

70 

42 

38 

15 

8 

12 

0 

8 

12 

50 

78 

63 

91 

21 

25 

20 

27 

24 

40 

26 

32 

70 

29 

41 

20 

11 

16 

20 

11 

18 

0 

11 

18 

110 

69 

72 

50 

9 

10 

15 

13 

6 

0 

13 

6 

90 

72 

69 

38 

54 

43 

5 

4 

1 

1 

5 

0 

2 

7 

13 

20 

4 

2 

3 

3 

2 

0 

3 

2 

90 

64 

66 

62 

4 

8 

15 

8 

10 

0 

8 

10 

6 

3 

3 

0 

3 

3 

5 

4 

2 

0 

4 

2 

20 

8 

12 

37 

1 

1 

1 

0 

0 

0 

0 

0 

2 

1 

0 

0 

1 

0 

5 

2 

4 

0 

2 

4 

3 

6 

4 

6 

0 

8 

12 

5 

9 

3 

5 

9 

3 

1 

2 

a 

1 

2 

100 

99 

96 

85 

68 

52 

.02 

.12 

.13 

.19 

4 

4 

35 

47 

41 

52 

2 

4 

5 

2 

2 

0 

2 

2 

12 

23 

22 

19 

-JS 

-10 

4 

3 

1 

0 

3 

1 

3 

2 

0 

0 

2 

0 

10 

8 

6 

0 

8 

6 

3 

2 

3 

0 

2 

15 

13 

7 

0 

13 

7 
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TABLE  E-4 
(continued) 


Maximum 

Utility 

Faraaetor 


Parameter 

Utility 

Value 

Value 

9.6.1  Number  of  subscribers 
end-to-end  secure 

9.6.2  Number  of  subscribers  link 
secure  (not  end-to-end) 

9.6.3  Percent  subscribers  not  end- 
to-end  that  can  be  upgraded 

9.7.1  EMC/EMV  Intercept 

10.1.1  Nusiber  of  directory  listings 

10.1.2  Number  of  directory  users 

10.1.3  Number  of  personnel 

10.1.4  Complexity  of  system* 

lu.2.1  Service  features* 

11.1.1  Number  of  equipment  categories 


Manhours  preventive  maintenance 

Percent  maintenance  hours 

without  equipment 

Volume  of  preventive 

nalntenance  parts 

Ease  of  preventive  maintenance' 

Manhours  corrective  nalntenance 

Percent  nalntenance  houra 

without  equipment 

Volume  of  corrective 

nalntenance  parts 

NORM  rata 

Ease  of  corrective  maintenance' 
Manhours/ language  - continual 
Manhours/language  - special 
Easa  of  softwara  maintenance* 

EMC/EMV  spectrum  requirements 
RF  spectrum  flexibility* 

EMC/EMV  INTACS  compatibility 
EMC/EMV  I NT ACS/other  system 
compatibility 


12.1.1 

12.1.2 

12.1.3 

12.1.4 
12.2.1 
12.2.2 

12.2.3 

12.2.4 

12.2.5 

12.3.1 

12.3.2 

12.3.3 

13.1.1 

13.2.1 

14.1.1 

14.2.1 


• qualitative  HOE 


Baseline 


37  31 

83  70 

100  87 

13  19 

48  26 

37  35 

19  18 

2 4 

9 3 

65  61 

22  20 
70  74 

14  13 


7 5 


5 4 


0 

60 

47 

9 

69 

12 

9 

15 

.27 

.35 

.61 

2 

2 

0 

53 

48 

22 

21 

1 

23 

1 

20 

0 

26 

25 

27 

14 

16 

0 

92 

89 

87 

92 

91 

85 

2 

14  16 


658  574 


Utiles 


GOS 


FIGURE  E-2 


FIGURE  E- 


1.00 

0.97 

0.95 


0.68 


System  X 
System  Y 


Baseline 


Grade  of  Service  Evaluation 


Utiles 


40 

32 

26 

20 


GOS 


20 

24  System  Y 
27  System  X 
30 


0 


40  Baseline 


3 System  Weight  Evaluation 
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practical.  The  evaluation  results  are  presented  in  Table  E-4,  under 
"utility  value".  Next,  each  of  these  values  is  summed  into  the  appro- 
priate aspect  (Table  E-5) , and  the  aspects  are  combined  into  areas 
(Table  E-6) . 

The  quantitative  and  qualitative  MOEs  may  be  added  separately  if 
desired,  as  shown  in  Tables  E-7  and  E-8,  respectively. 

To  discover  how  one  system  differs  from  another  (even  if  total 
utilities  are  the  same),  the  evaluation  process  must  be  examined  care- 
fully. Each  area  and  aspect  that  suggests  significant  distinction  be- 
tween the  systems  will  be  investigated.  In  the  example  under  considera- 
tion, the  most  prominent  area  is  quality  of  service,  with  a difference 
of  85  utiles  between  the  systems.  The  primary  sources  of  this  are  speed 
of  service  and  information  quality.  Although  it  is  not  possible  in  this 
example,  the  Task  V analysis  will  address  an  additional  level  of  detail 
by  discussing  the  actual  system  characteristics  that  contribute  to  those 
differences.  This  will  aid  the  decision-maker  in  understanding  the  fun- 
damental differences  between  the  systems  and  how  these  differences  are 
reflected  in  the  analysis. 


3.0  SENSITIVITY  TO  PARAMETER  VARIATION 

In  this  part  of  the  analysis,  each  system  parameter  is  varied  a 
specified  amount  to  determine  the  sensitivity  of  the  FOM  to  this  varia- 
tion. Three  parameter  values  of  System  X were  reduced  5 percent  to 
demonstrate  the  procedure.  The  first  variation  was  for  grade  of  service. 

A change  from  97  to  92  decreased  the  utility  by  24  utiles.  Increasing 
the  system  weight  by  5 percent  reduced  the  utility  by  only  2 utiles,  while 
a 5 percent  variation  in  "reduction  of  GOS  due  to  different  ratios  of  data 
to-voice  traffic"  produced  no  change  in  utility.  The  remainder  of  this 
analysis  is  presented  in  Table  E-9.  An  obvious  conclusion  is  that  System 
X is  quite  sensitive  to  variations  in  grade  of  service,  and  care  should 
be  taken  to  ensure  the  validity  of  this  number. 


4.0  SENSITIVITY  TO  UTILITY  ALLOCATION 

Due  to  the  use  of  human  judgement,  a lack  of  precision  is  inherent 
in  the  utility  allocation.  To  gain  some  insight  into  the  effect  of  these 
errors,  a utility  allocation  sensitivity  analysis  is  performed.  A small 
variation  (10  percent)  is  introduced  in  the  utility  allocation,  and  the 
resulting  change  in  system  utility  is  noted.  To  present  the  worst  case 
for  this  example,  utility  allocations  were  reduced  by  10  percent  for  each 
MOE  in  which  the  preferred  System  X scored  higher  than  System  Y.  If  Y 
was  higher  than  X,  the  allocation  was  increased  for  the  respective  MOE. 
Even  with  this  variation.  System  X was  still  preferred,  615.2  utiles  to 


TABLE  E-5 

Aspect  Utility  Evaluation 


Utility  Value 


Areas  and  Aspects 


ality  of  Service 


1.1  Grade  of  service 

1.2  Speed  of  service 

1. 3 Information  quality 

Mobility 


2.1  Setup/teardown  time 

2.2  Communication  during  moves 

Tran  sportabillty 

3.1  Equipment  site  and  weight 

3. 2 Vehicle  requirements 

3.3  Portability 

Vulnerability 


4.1  Physical  destruction 

4.2  Susceptibility  to  direction-finding 

Survivability 

5.1  Impact  of  nodal  destruction 

5.2  Impact  of  jamming 

Flexibility 

6.1  Function  in  varying  operational  environments 

6.2  Changes  in  force  structure 

6.3  Change  of  mission 

6.4  Varying  ratios  of  traffic 

6.5  Impact  of  additional  subscribers 

6.6  System  modularity 

6.7  Downtime  for  CP  displacement 

6.8  Operation  in  varying  deployments 

6.9  Hardware  modularity 

Rellabllit 


7.1  System  availability 


TABLE  E-5 
(continued) 


Utility  Value  f| 

Areas  and  Aspects 

X 

Y 

8.  Logistical  Support 

8.1  Required  parts  support 

8 

10 

8.2  Power  requirements 

-15 

-10 

9.  Security 

9. 1 Provision  for  increased  secure 

3 

1 

communications 

9.2  Limitations  due  to  increased  security 

2 

0 

9.3  Ratio  of  secure-to-nonsecure  users 

8 

6 

9.4  Interface  security  requirements 

2 

3 

9.5  Restoration  after  compromise 

13 

7 

9.6  Degree  of  security 

20 

15 

9.7  Interceptibility 

18 

11 

10.  Operability 

10.1  Difficulty  of  system  operation 

-1 

3 

10.2  Service  features 

9 

3 

11.  Standardization 

1 

11.1  Multiplicity  of  CE  equiprent  , 

-2 

-1 

12.  Maintainability 

12.1  Provision  of  preventive  maintenance'  "* 

w ..  3/ 

, 5 

12.2  Provision  of  corrective  maintenance 

10 

12 

12.3  Provision  of  software  update 

0 

0 

13.  RF  Spectrum  Requirements 

13.1  RF  bandwidth  requirements 

1 

2 

13.2  Flexibility  of  frequency  allocation 

14 

6 

14.  Electromagnetic  Compatibility 

14.1  INTACS  compatibility 

8 

5 

14.2  INTACS/other  system  compatibility 

8 

8 

658 

574  utiles 

E-15 


1 


TABLE  E-6 

Total  Utility  Awarded  Each  Area 


Utility  Value 

Area 

x 

Y 

Quality  of  service 

236 

151 

Mobility 

59 

84 

Transportability 

69 

91 

Vulnerability 

76 

59 

Survivability 

16 

12 

Flexibility 

25 

39 

Reliability 

68 

52 

Logistical  support 

-7 

0 

Security 

66 

43 

Operability 

8 

6 

Standardization 

-2 

-1 

Maintainability 

13 

17 

RF  spectrum  requirements 

15 

8 

Electromagnetic  compatibility 

16 

13 

658 

574  utiles 

TABLE  E-7 

MOE  Utility  (Quantitative)  A 


Area 


Quality  of  service 
Mobility 

Transportability 

Vulnerability 

Survivability 

Flexibility 

Reliability 

Logistical  support 

Security 

Operability 

Standardization 

Maintainability 

RF  spectrum  requirements 

Electromagnetic  compatibility 


E-17 


Utility  Value 

“ Y 


236 

151  | 

51 

72 

58 

73  | 

63 

53  l 

13 

io  ! 

1 

9 : 

68 

52 

-9 

-2 

38 

26 

-3 

.01 

-2 

01 

9 

12 

1 

2 

16 

13 

540 

469  utiles 

TABLE  £-8 

MOE  Utility  (Qualitative)  Awarded  Each  Area 


Area 

j Utility  Value 

X 

Y 

Quality  of  service 

__ 

Mobility 

8 

12 

Transportability 

11 

18 

Vulnerability 

13 

6 

Survivability 

3 

2 

Flexibility 

24 

30 

Reliability 

— 

— 

Logistical  support 

2 

2 

Security 

28 

17 

Operability 

11 

7 

Standardization 

— 

— 

Maintainability 

4 

5 

RF  spectrum  requirements 

14 

6 

Electromagnetic  compatibility 

— 

— 

118 


105  utiles 


L 


TABLE  E-9 

Systam  X Parameter  Sensitivity  Analysis 


MOE 


1.1.1  Grade  of  service 

1.2.1  Speed  of  service 

1.3.1  System  communicability  score 


2.1.1  Physical  setup/teardown  time 

2.2.1  Percent  COS  reduction 
during  a move 

2.2.2  Information  intelligibility* 


3.  ?.  1 


Volume  of  system 

Weight  of  system 

Percent  transport  vehicles 

organic 

Portability* 


4.1.1  FEBA  centroid  function 

4.1.2  Susceptibility  to  destruction* 
4.2.1  EMC/'EMV  direction-finding 


5.1.3 
3.2. 1 


Number  of  nodes  destroyed  to 
reduce  GOS  to  apeclfled  level 
Subscriber  loss  due  to  nodal 
destruction 

Alternate  capabilities* 
EMC/EMV  jamming  vulnarability 


Operational  environment* 
Force  structure* 

Change  in  mission* 

Variation  of  date /voice 
traffic  ratio 
Date  transmission* 

Addition  of  subscribers* 
System  modularity* 

Downtime  for  CP  displacement 
Various  deploymsnts* 

Hardware  modularity* 


7.1.1  Parcant  system  availability 


8.1.1  NORS  rata 

8.1.2  Volume  of  parts  inventory 

8.1.3  Ease  of  support* 

8.2.1  Total  powar 


9.1.1  Ability  to  increase  cecurity* 

9.2.1  Limitations  of  increase* 

9.3.1  Ratio  of  eacure-to-nonaecura* 


Para- 

meter 

Value 

Para- 

meter 

Vari- 

ation 

(+) 

.97 

.05 

.98 

.05 

86 

4.3 

12 

.6 

26 

1.3 

99 


78 

4 

27 

1.4 

29 

1.6 

11 

-.6 

69 

3.5 

13 

.7 

72 

3.6 

E-19 


New 

Parameter 

Value 


New 

Utility  Value 


+ 

- 

+ 

1.00 

.92 

110 

71 

1.00 

.93 

80 

69 

90.3 

81.7 

67 

56 

12.6 

11.4 

8 

11 

27.3 

24.7 

40 

43 

8.4 

7.6 

8.4 

7.6 

82 

74 

19 

22 

28.4 

25.6 

?4 

29 

30.6 

27.4 

12 

10 

11.6 

10.4 

11.6 

10.4 

72.5 

65.5 

10 

8 

13.7 

12.3 

13.7 

12.3 

75.6 

68.4 

57 

44 

4.2 

3.8 

5.1 

4.5 

7.4 

6.6 

3.8 

4.2 

3.1 

2.9 

3.1 

2.9 

67.2 

60.8 

10 

3 

8.4 

7.6 

8.4 

7.6 

3.1 

2.9 

3.1 

2.9 

4.2 

3.8 

4.2 

3.8 

8.4 

7.6 

1 

1 

100  94 


70 


57 


Range  of 
Utility 
Variation 


.8 


1.2 


13 


* Qualitative  MOE 


TABLE  F.-9 
(cont lnued) 


New 

Parameter  New  Range  ol 

Value  Utility  Value  utility 

Variation 


9.4.1  Interface  security 
re<|u  i rements* 

9.5.1  Compromise  restoral* 

9.6.1  Number  of  subscribers  end-to- 
end  secure 

9.6.2  Number  of  subscribers  link 
secure  (not  end-  to-end) 

9.6.3  Percent  subscribers  not  end- 
to-end  that  can  be  upgraded 

9.7.1  KMC/ 1. MV  Intercept 

10.1.1  Number  of  directory  listings 

10.1.2  Number  of  directory  users 

10.1.3  Number  of  personnel 

10.1.4  Complexity  "f  system* 

10.2.1  Service  features* 

11.1.1  Number  of  equipment  categories 

12.1.1  Manhours  preventive  maintenance 

12.1.2  Percent  maintenance  hours 
without  equipment 

12.1.3  Volume  of  preventive 
maintenance  parts 

12.1.4  Er.se  of  preventive  maintenance* 

12.2.1  Manhours  corrective  maintenance 

12.2.2  Fercent  maintenance  hours 
without  equipment 

12.2.3  Volume  of  corrective 
maintenance  parts 

12.2.4  NORM  rate 

12.2.5  Ease  of  corrective  maintenance* 

12.1.1  Manhours/ language  - continual 

12.3.2  Manhours/ language  - special 

12.3.3  Ease  of  software  maintenance* 

13.1.1  EMC/EMV  spectrum  requirements 

13.2. 1 RF  spectrum  flexibility* 

14.1.1  EMC/EMV  INTACS  compatibility 

14.2.1  EMC/EMV  INTACS/other  system 
compatibility 


13.7  17.1  H-7  12.1 

38. 9 35.  1 9 7 

H7, 7 78.8  7.5  6 

100  95  5 4.8 


13.7  12.3 


16.5  19 


50.4  45.6  -3.1 

38.9  35.1  -1 

20  18  1 

2.1  1.9  2.1 


9.5  8.5 

68.  1 61.7 

23.1  20.9 

73.5  66.5 


.284  .256 

2.1  19 

55.6  50.4 

22.1  19.9 

1.1  .9 


-3.1  -2.9 

-1  -1 

1 1 

2.1  1.9 


9.5  8.5 

-2.5  -1 


14.7  13.3  1 


12.6  11.4 


.256  6.5 

1.9  2.1 


27.  3 24.7  .5  3 

14.7  13.3  14.7  13.3 


* Qualitative  MOE 


559.0  utiles.  If  desired,  this  can  be  separated  into  qualitative  and 
quantitative  parts,  as  shown  below. 


Svstem  X 

System  Y 

Quantitative 

Qualitative 

500.2 

115.0 

449.9 

108.1 

Total 

615.2 

558.0 

The  information  can  also  be  generated  for  every  area,  aspect,  and 

MOE. 

The  next  step  is  to  ascertain  the  percentage  eiror  required  to  make 
the  two  systems  rank  exactly  equal.  The  necessary  variation  was  calcu- 
lated to  be  31  percent.  This  allocation  is  presented  in  Table  E-10  for 
each  MOE,  and  is  summed  into  the  respective  areas  in  Table  E-ll.  If  the 
analysis  were  based  only  on  quantitative  MOEs,  the  percentage  change 
would  be  34  percent.  The  exclusive  use  of  qualitative  MOEs  would  require 
a 21  percent  variation  to  create  equal  ranking.  The  process  could  be 
repeated  to  establish  the  percent  error  at  area  or  aspect  levels  for 
equal  ranking. 
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TABLE  E-10 

Alternate  Allocation  of  Utility  to  MOEs 


MOE 

Utility 

1.1.1  Grade  of  service 

83.1 

1.2.1  Speed  of  service 

60.3 

1.3.1  Syptem  communicability  score 

52.8 

<;  2.1.1  Physical  setup/teardown  time 

57.3 

2.2.1  Percent  GOS  reduction  during  a move 

33.9 

2.2.2  Information  intelligibility 

21.5 

3.1.1  Volume  of  system 

43.0 

3.1.2  Weight  of  system 

57.3 

3.2.1  Percent  transport  vehicles  organic 

28.6 

3.3.1  Portability 

28.6 

A. 1.1  FEBA  centroid  function  / 

21.5 

4.1.2  Susceptibility  to  destruction 

11.4 

4.2.1  EMC/EMV  direction-finding 

45.2 

5.1.1  Number  of  nodes  destroyed  to  reduce  GOS 

4.5 

to  specified  level 

5.1.2  Subscriber  loss  due  to  nodal  destruction 

4.5 

5.1.3  Alternate  capabilities 

2.3 

5.2.1  EMC/EMV  jamming  vulnerability 

35.8 

6.1.1  Operational  environment 

21.5 

6.2.1  Force  structure 

6.6 

6.3.1  Change  in  mission 

3.7 

6.4.1  Variation  of  data/voice  traffic  ratio 

1.1 

6.4.2  Data  transmission 

1.1 

6.5.1  Addition  of  subscribers 

1.5 

6.6.1  System  modularity 

7.2 

6.7.1  Downtime  for  CP  displacement 

14.3 

6.8.1  Various  deployments 

17.2 

6.9.1  Hardware  modularity 

4.3 

7.1.1  Percent  system  availability 

52.8 

8.1.1  NORS  rate 

10.9 

8.1.2  Volume  of  parts  inventory 

7.2 

8.1.3  Ease  of  support 

5.5 

8.2.1  Total  power 

43.0 

tabu:  i 1 o 

(font  imiod) 


9.7.1 

10.1.1 
10. 1.2 

10.1.3 

10.1.4 
10.2.1 


MOE 

Ability  to  increase  security 
Limitations  of  increase 
Ratio  of  secure-to-nonsecure 
Interface  security  requirements 
Compromise  restoral 

Number  of  subscribers  end-to-end  secure 
Number  of  subscribers  link  secure 
Percenr  subscribers  not  end-to-end 
that  can  be  upgraded 
EMC/EMV  intercept 

Number  of  directory  listings 
Number  of  directory  users 
Number  of  personnel 
Complexity  of  system 
Service  features 


11.1.1  Number  of  equipment  categories 

12.1.1  Manhours  preventive  maintenance 

12.1.2  Percent  maintenance  hours  without  equipment 

12.1.3  Volume  of  preventive  maintenance  parts 

12.1.4  Ease  of  preventive  maintenance 

12.2.1  Manhours  corrective  maintenance 

12.2.2  Percent  maintenance  hours  without  equipment 

12.2.3  Volume  of  corrective  maintenance  parts 

12.2.4  NORM  rate 

12.2.5  Ease  of  corrective  maintenance 

12.3.1  Manhours/ language  - continual 

12.3.2  Manhours /language  - special 

12.3.3  Ease  of  software  maintenance 

13.1.1  EMC/EMV  spectrum  requirements 

13.2.1  RF  spectrum  flexibility 

14.1.1  EMC/EMV  INTACS  compatibility 

14.2.1  EMC/EMV  INTACS/other  system  compatibility 


Utility 

3.1 

22.3 
7.5 

4.3 

11.4 
11.4 

7.5 

3.7 

18.8 

4.3 

1.1 
1.1 

7.2 
7.5 

14.3 

11.5 

2.2 
2.2 
4.3 

7.2 

2.8 
2.8 
6.0 

3.3 
1.1 
1.1 
3.3 

14.3 
15.1 

11.4 

16.4 

1000.0  utiles 
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Area 

Utility 

Quality  of  servlca 

196.2 

Mobility 

112.7 

Tranaportablllty 

157.5 

Vulnerability 

78.1 

Survivability 

47.1 

Flexibility 

78.5 

Reliability 

52.8 

Logistical  support 

66.6 

Security 

70.0 

Operability 

21.2 

Standardization 

14.3 

Maintainability 

47.8 

RF  spectrum  requirements 

29.4 

Electromagnetic  compatibility 

27.8 

1000.0  utiles 
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APPENDIX  F 

COST/EFFECTIVENESS  MODEL  SENSITIVITY  ANALYSIS 


1.0  REQUIREMENT  FOR  SENSITIVITY  ANALYSIS 


The  effectiveness  methodology  for  the  INTACS  evaluation  contains  63 
measures  of  effectiveness.  Early  in  the  evaluation,  it  must  be  determined 
that  the  model  is  a good  model,  and  one  way  to  make  this  determination  is 
to  conduct  a sensitivity  rnalysis  of  the  impact  on  the  system  evaluation 
of  changes  in  certain  parameters.  This  will  provide,  an  indication  that 
the  model  works  if  specific  changes  in  input  (variation  in  parameters  that 
contribute  to  the  value  of  MOEs)  result  in  reasonable  changes  to  output 
(system  effectiveness  as  evaluated  by  these  63  MOEs). 

This  type  of  sensitivity  analysis  can,  in  fact,  be  conducted  prior  to 
beginning  the  actual  evaluation  of  the  candidate  systems.  Such  an  analysis 
will  be  relatively  accurate  if  the  evaluation  can  identify  the  contributing 
factors  to  each  of  the  MOEs.  (It  is  recognized  that  some  factors  contri- 
bute to  more  than  one  HOE.)  After  allocation  of  utiles  to  all  63  MOEs, 
the  utile  significance  of  a contributing  factor  can  be  determined.  The 
factors  can  then  be  rank-ordered  by  utile  significance,  and  this  ranking 
will  indicate  the  parameters  to  which  the  model  is  most  sensitive.  These 
results  will  provide  an  early  indication  of  whether  or  not  the  model  is  a 
good  model. 

The  remainder  of  this  appendix  will  illustrate  the  results  of  such  a 
sensitivity  analysis  * first,  by  developing  the  procedure  for  conducting 
the  analysis;  then  by  giving  the  results  of  the  analysis;  and  finally,  by 
providing  the  conclusions  of  the  study  team. 


2.0  PROCEDURE 


Certain  MOEs  are  contributing  factors  to  other  MOEs.  Figure  F-i 
illustrates  the  hypothetical  relationship  of  four  MOEs  to  two  other  MOEs. 
These  same  relationships  are  also  illustrated  in  Table  F-l,  where  contri- 
buting factors  are  indicated  in  the  row  for  each  MOE  (i.e.,  Cl  and  C2 
influence  Ml;  C2,  C3,  and  CA  influence  M2).  Summing  cross  marks  down  the 
columns  yields  the  total  number  of  MOEs  influenced  by  each  contributing 
factor. 


■ significance  of  each  contributing 

Figure  F-2  illustrates  the  possible  sig  simllarly>  Table  F_2  de- 
factor to  the  overall  evaluation  of  e each  MOE.  Summing  the  fractions 
picts  this  relationship  in  the  row  that,  in  each  case , some 

across  any  row  will  give  '“!!  ntt°factors  yields  a total  evaluation  of  the 

^‘Tigu™  F-^'d  S5fw  5^1*  »*■  "i6ht  h*Ve  the 

viously-described  relationship. 

Fur  e„.pl.,  portability  of  a ayateo  la  evaluated  in  te™  of  throe 
other  MOEsj 

• Size 

• Weight 

• Hardware  modularity. 

*.  relative  significance  of  these  contributing  factors  to  the  total 
evaluation  of  portability  might  be. 

• Size,  30  percent 

• Weight,  40  percent 

• Hardware  modularity,  30  percent. 

Thi.  -.an.  that  a aignificantimprovement  in  modularity  «ight  result  in  a 
30  percent  improvement  in  portability. 

The  relettv.  algnlflcanc.  of  “iScT.^ 

for*each  «»1  significance,  of  each  contributing  fan- 

tor  can  be  calculated. 

Fro.  the  exaeple  in  Appendix  .»  the  utility  allocation  for  these  d«- 
pendent  HOEs  is  J 

• Volume  of  parts  inventory  (5  utiles) 

• Portability  (20  utiles). 

Table  F-4  indicates  the 

factors  for  these  MOEs.  Re  values  the^  aUocation<  Table  f-5 
plying  the  relative  8^gnJfic“  !heae  factor8.  * The  sensitivity  analysis 
Su  ESlSVSS? S2. lor  the  63  MOEs  of  the  INTACS  Study,  using 
the  utility  allocation  in  Appendix  E. 


F-5 


FIGURE  F-2 

Relative  Significance  of  Contributing  Factors  to  Each  MOE 


Contributing  Factors  MOE 


I* 

t 

l 
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TABLE  F-2 

Relative  Significance  of  Contributing  Factors  to  Each  MOE 


3.0  RESULTS  OF  SENSITIVITY  ANALYSIS 


— 

I 

The  contributing  factors  for  each  of  the  63  MOEs  were  identified,  and 
their  relative  significance  was  indicated  in  a manner  similar  to  previously 
described  examples.  Table  F-6  indicates  the  relative  significance  of  all 
contributing  factors  for  the  MOEs.  (These  contributing  factors  are  actu- 
ally 26  of  the  63  MOEs.)  Table  F-7  indicates  the  utile  significance  of 
these  contributing  factors.  Table  F-8  indicates  the  system  sensitivity 
to  improvement  of  the  contributing  MOEs,  which  are  listed  in  order  of  rank- 
ing from  greatest  to  least  system  significance. 

Grade  of  service  was  found  to  be  more  than  twice  as  significant  as 
any  other  MOE.  Speed  of  service  and  the  susceptibility  of  transmitters 
to  direction-finding  are  considered  to  be  relatively  equal  in  significance. 
Equipment  weight  is  considered  to  be  more  significant  than  equipment  size. 

As  can  be  observed  from  the  ranking,  no  correlation  was  made  (nor  was 
any  Intended)  between  utility  significance  and  the  number  of  MOEs  influ- 
enced. Equipment  size  influenced  the  greatest  number  of  MOEs  (13),  and 
yet  this  factor  ranked  eighth  in  system  significance.  Speed  of  service 
Influenced  only  one  MOE,  and  yet  it  ranked  third  in  system  significance. 
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TABLE  F-» 

•eletiw  If  influence  of  Contributing  Pact  ore 
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3.1  IMPACT  OF  HIGH  VARIATION  OF  PARAMETERS 

Tables  F-6,  F-7,  and  F-8  illustrate  the  significance  of  26  contributing 
MOEs  to  the  effectiveness  evaluation.  These  tables  are  based  upon  the  ex-  ^ 
pected  contribution  of  «ach  MOE  under  what  could  be  termed  normal  conditions  , 
where  the  values  for  the  MOEs  (parameters)  do  not  undergo  extreme  variation. 

In  a further  analysis,  the  relative  significance  of  contributing  MOEs 
was  estimated  for  conditions  of  high  parameter  variation.  That  is,  the 
values  for  each  of  these  measures  differ  significantly  among  the  alterna- 
tive concepts.  The  results  of  this  additional  consideration  are  indicated 
in  Tables  F-9  (relative  significance)  and  F-10  (utile  significance).  A 
comparison  of  the  differing  results  of  normal  and  high  parameter  variation 
ia  indicated  in  Table  F-ll.  As  can  be  seen  from  this  table,  high  parameter 
change  somewhat  modifies  the  relative  significance  of  certain  contributing 
MOEs.  For  example,  hardware  modularity  is  reduced  in  significance  by 
greater  than  50  percent.  Three  MOEs  that  become  more  significant  under 
conditions  of  high  parameter  change  are  the  ability  to  provide  increased 
security,  distance  from  FEBA,  and  alternate  capabilities. 

The  study  team  found  that  the  results  of  this  sensitivity  analysis 
Indicated  the  model  was  properly  sensitive  to  parameter  variation.  Using 
the  procedure  developed  above,  th'.s  sensitivity  analysis  can  be  checked 
during  the  course  of  the  evaluation. 
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TABLE  F-ll 
Utile  Significance 


Parameter  Change 

Rank  [l 

HOE 

Normal 

High 

Normal 

High 

Grade  of  service 

164.05 

161.1 

1 

1 

Direction-finding 

82 

90 

2 

2 

Speed  of  service 

80 

80 

3 

3 

Availability 

71.6 

77.4 

4 

4 

Communicability 

70 

70 

5 

5 

"/eight 

61.9 

61 

6 

6 

RF  spectrum 

61.45 

57.4  | 

7 

7 

Size 

56.75 

58.7 

8 

8 

Setup/teardown 

39.3 

43 

9 

9 

Modularity 

37 

16 

10 

17 

S/N  threshold 

36.3 

40 

11 

10 

Power  requirements 

33.4 

34.7 

12 

11 

Jamming 

31.7 

29.3’ 

13 

12 

MOS  requirements 

23.1 

22 

14 

16 

Ability  to  increase  security 

21.8 

28.3 

15 

13 

FEBA  centroid  function 

20.25 

25.1 

16 

14 

Number  end-to-end  secure 

19.4 

15 

17 

18 

Ease  of  logistical  support 

14.5 

12.3 

18 

19 

Number  link  secure 

14.4 

10 

19 

21 

Alternate  capabilities 

12.2 

22.8 

20 

15 

Standardization 

10.4 

10.2 

21 

20 

Service  features 

10 

10 

22 

21 

Complexity 

9 

9 

23 

24 

Ease  of  corrective  maintenance 

8.1 

5 

24 

25 

Ease  of  software  updates 

7.3 

6.5 

25 

24 

Ease  of  preventive  maintenance 

4.1 

5 

26 

25 
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4.0  IMPACT  OF  ELIMINATION  OF  LEAST  SIGNIFICANT  MOEa 


Reduction  of  the  number  of  MOEs  required  in  the  evaluation  of  the 
alternative  systems  is  highly  desirable;  therefore,  a study  was  conducted 
of  the  likely  impact  of  such  a reduction,  by  considering  the  same  evalu- 
ation discussed  in  Appendix  E. 

The  ?6  MOEs  that  receive  the  greatest  allocation  of  utiles  were  iden- 
tified and  isolated  for  a separate  evaluation.  Table  F-12  lists  these 
MOEs  and  provides  the  utile  significance  of  their  contributing  factors. 
Table  F-13  lists  the  total  utile  significance  of  the  contributing  factors 
and  compares  the  ranking  of  these  factors  when  63  and  26  MOEs  are  consi- 
dered. As  can  be  observed,  the  17  most  significant  contributing  factors 
for  the  63  MOEs  are  also  the  17  most  significant  contributing  factors  when 
only  26  MOEs  are  considered,  and  no  major  changes  occurred  in  the  ordering 
of  these  factors. 

Table  F-14  lists  the  26  MOEs  and  the  utile  allocation  for  sample  Sys- 
tems X and  Y from  Appendix  E.  The  system  ranking  remains  unchanged  when 
only  26  MOEs  are  used.  In  fact,  the  relative  superiority  of  System  X over 
System  Y is  14.8  percent  when  63  MOEs  are  considered,  and  15.2  percent  when 
only  23  MOEs  are  considered.  Thus,  use  of  the  26  primary  MOEs  accounted 
for  80.5  percent  of  the  total  utiles  allocated,  and  resulted  in  no  appre- 
ciable difference  in  system  ranking. 

This  method  tor  reducing  the  number  of  MOEs  that  contribute  to  the 
system  evaluation  could  be  applied  in  Task  V after  the  study  team  is  pro- 
vided the  actual  utile  allocation.  All  other  MOEs  could  then  be  addressed 
in  narrative  form  to  compare  the  systems,  but  need  not  contribute  to  the 
total  utility  for  each  system. 
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TABLK  F- 1 3 

Utile  Sign  If  leaner  of  Contributing  Factors 
for  26  Primary  MOFs 


Grade  of  service 
Direction- finding 
Speed  of  service 
Availability 
Communicability 
Weight 
RF  spectrum 
Size 

Setup/teardown 
Modularity 
S/N  threshold 
Power  requirements 
Jamming 

MOS  requirements 
Ability  to  increase  security 
FEBA  centroid  function 
Number  of  end-to-end  secure 
Ease  of  logistical  support 
Number  of  link  secure 
Alternate  capabilities 
S tandardlzat ion 
Service  features 
Complexity 

Ease  of  corrective  maintenance 
Ease  of  software  update 
Ease  of  preventive  maintenance 


Parameter 

■ Change 

Normal 

High 

164.05 

148.25 

82 

82 

80 

80 

71,6 

70 

70 

70 

61.9 

59.5 

61.45 

43.25 

56.75 

47.5 

39.3 

34 

37 

23 

36.3 

32.25 

33.4 

30.75 

31.7 

28 

23.1 

4 

21.8 

15 

20.25 

20.25 

19.4 

15 

14.5 

— 

14.4 

— 

12.2 

1.5 

10.4 

— 

10 

— 

9 

— 

8.1 

— 

7.3 

0.75 

4.1 

— 

Rank 


Normal  High 
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TABLE  F-14 

Utility  Values  for  23  Primary  MOEs 
and  Sample  Systems  X and  Y 


Maxiniiiri 

Utility  Value  (j 

MOE 

Utility 

X 

Y 

1.1.1 

Grade  of  service 

110 

95 

84 

1.2.1 

Speed  of  service 

80 

N 

41 

1.3.1 

Codftuni  cab  i li  ty 

70 

26 

2.1.1 

Setup/teardown  time 

40 

34 

2.2.1 

GOS  reduction  during  move 

45 

42 

38 

2.2.2 

Information  intelligibility* 

15 

8 

12 

3.1.1 

Volume  of  system 

30 

21 

25 

3.1.2 

Weight  of  system 

40 

26 

32 

3.2.1 

Percent  transport  ’’“.hides 
organic 

20 

11 

16 

3.3.1 

Portability* 

20 

11 

18 

4.1.1 

FEBA  cendold  function 

15 

9 

10 

4.1.2 

Susceptibility  to  destruction* 

15 

13 

6 : 

4.2.1 

Direction- find  ?. 

60 

54 

43 

5.2.1 

Jamming  vulnerability 

25 

4 

8 

6.1.1 

Operational  * vi  • i*u»ent* 

15 

8 

10 

7.1.1 

Percent  system  availability 

70 

68 

52 

8.2.1 

Total  powc 

30 

-15 

-10 

9.5.1 

Compromise  restcral* 

15 

13 

7 

9.6.1 

Number  of  subscribers 
end-to-end  secure 

15 

8 

6 

9.7.1 

Interceptibillty 

25 

18 

11 

13.2.1 

RF  spectrum  flexibility* 

20 

14 

16 

14.1.1 

INTACS  compatibility 

15 

8 

5 

14.2.1 

INTACS/other  system 
compatibility 

15 

8 

1 i 

8 

805 

J 

574 

498 

* Qualitative  MOE 


5.0  DEPENDENCE  OF  EFFECTIVENESS  METHODOLOGY 
ON  SUBJECTIVE  JUDGEMENT 


Subjective  Judgement  is  required  throughout  the  INTACS  methodology 
for  evaluating  system  effectiveness.  Figure  F-4  illustrates  a judgement 
trail  from  the  pre-evaluation  allocation  of  utiles  for  each  MOE  to  the 
post-evaluation  assignment  of  utiles  for  the  specific  value  of  each  MOE. 

Four  separate  stages  in  the  system  evaluation  are  specified: 

* Allocation  of  utiles 

* Input  data  and  conditions 

0 Evaluation  procedure 

0 Assignment  of  utiles. 

lhe  initial  allocation  of  utiles  normally  requires  subjective  judge- 
ment at  three  levels:  areas,  aspects,  and  measures  of  effectiveness.  How- 
ever, for  some  MOEs,  judgement  at  all  three  levels  is  unnecessary  (e.g., 
in  the  case  of  only  one  aspect  within  an  area  or  only  one  MOE  within  an 
aspect). 

The  input  data  and  conditions  relate  only  to  quantitative  MOEs,  since 
the  entire  evaluation  of  qualitative  MOEs  is  considered  a single  subjec- 
tive Judgement,  with  relevant  conditions  noted  but  not  measured.  Several 
of  the  quantitative  MOEs  require  COMSR  data  as  direct  or  indirect  input. 

The  determination  of  OOMSRs  was,  in  part,  a judgemental  exercise.  MOEs 
that  require  the  scenario  and  specified  deployment  as  a frame  of  reference 
are  requiring  additional  subjective  Judgement. 

The  evaluation  procedure  is  subjective,  of  course,  for  all  qualitative 
MOEs.  Some  of  the  quantitative  MOEr  will  be  evaluated  by  the  network  models 
(CASE  and  SIMCE)  or  by  the  IPM.  These  MOEs,  and  many  more,  are  based  upon 
a sized  system,  which  is  an  additional  dependence  on  SIMCE.  While  the  net- 
work models  att >mpt  to  represent  telephone,  teletype,  and  data  networks, 
they  are  partly  tie  result  of  (previously  made)  judgement  as  to  what  approxi- 
mations are  acceptable  as  representative  of  such  networks.  Thus,  to  the 
extent  that  the  model  is  not  totally  representative  of  telephone,  teletype, 
or  data  networks,  a degree  of  subjective  judgement  can  be  traced  to  the 
use  of  these  models.  Additionally,  some  MOEs  require  assignment  of  weights 
to  the  output  of  these  models. 

Finally,  the  assignment  of  utiles  to  the  evaluated  MOEs  requires  sub- 
jective judgement  as  to  the  relative  significance  of  improvement  (or  degra- 
dation) from  the  baseline  system. 
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Figure  F-5  illustrate*  the  judgement  trail  for  the  quantitative 
gradeof  service.  Similarly,  Figure  F-6  is  the  judgement  trail  for  the 
qualitative  MOE  ability  to  function  in  various  operational  environments. 

For  the  output  of  Task  V to  be  meaningful , the  frequency  and  nature  of 
th.  rt  .ubjective  i«dg««nt  should  ‘“llJ  ihuf10 

out  the  evaluation,  results  of  such  judgement  w e effective- 

enabling a reevaluation  by  those  who  would  disagree.  While  the 
ness  evaluation  is  heavily  dependent  on  judgement,  this  provides  the  d 

consideration  of  a broader  spectrum  of  system  cap.- 

biiities  to  determine  overall  system  performance. 
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APPENDIX  G 

EVALUATION  OF  SINGLE-CHANNEL  SYSTEMS 
IN  THE  MID  RANGE  TIME  FRAME 


1.0  COMMUNICATIONS  SUPPORT  REQUIREMENTS 


The  GOMSRs  specify  communications  requirements  by  mode,  precedence, 
message  length,  security  classification,  and  originator  access  need  (land- 
fixed,  land-mobile,  airborne,  and  waterborne).  All  traffic  with  other 
than  fixed  access  is  considered  to  be  a requirement  for  single-channel. 
Thus,  the  need  for  mobility  has  generated  a need  for  single-channel 
capabilities. 

When  a specific  need  for  single  channel  exists,  system  designers  will 
provide  that  capability,  selecting  and  assigning  equipment  based  primarily 
upon  range,  mobility,  and  reliability  requirements.  In  addition  to  speci- 
fic dictation  of  the  need  for  single  channel  by  the  COMSRs,  single  channel 
will  also  be  considered  as  an  alternative  in  satisfying  other  communica- 
tions support  requirements.  In  these  instances,  if  single  channel  is 
selected,  the  rationale  behind  the  selection  will  be  documented. 
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2.0  CONCEPT  DESIGN  FEATURES  FOR  SINGLE  CHANNEL 


TVo  communications  functional  areas  particularly  applicable  to  single 
channel  are: 

* Single-channel  transmission  facilities 

* Single- channel  access  to  multichannel  switching. 

Single-channel  transmission  facilities  include  VHF/FM  net  radio,  HF/SSB 
RATT  single-channel  TACSAT,  and  TRCS.  Upgraded  TACSA'l  single-channel  (UHF) 
transmission  facilities  will  be  introduced  into  the  inventory  during  the 
mid  range  time  frame.  These  equipments  will  be  considered  in  cases  where 
the  need  arises  for  single-channel/extended-range  communications  with  units 
or  forces  located  remotely  to  the  battle  area.  The  primary  advantages 
offered  by  TACSATCOM  are  quick  setup  times  and  extremely  long-range  capa- 
bilities. The  URC-78  series  technology  provides  the  TRCS  equipment  con- 
sidered for  the  mid  range  time  frame. 

The  multichannel  communications  system  presently  employs  a manual  radio- 
wire integration  (RWI)  facility  to  give  a net  radio  and  mobile  user  a means 
to  access  the  system.  One  INTACS  approach  provides  an  automated  RWI  (ARWI) 
facility  at  Division  and  higher  echelons.  During  Task  V,  various  techniques 
will  be  evaluated  to  determine  the  optimum  technique  for  implementing  the 
ARWI  function. 

Figure  G-l  provides  the  conceptual  desipu  features  for  single  channel 
in  Theater  Army  and  Corps.  Figures  G-2  and  G-3  provide  these  conceptual 
design  features  for  Division  and  Separate  Brigade.  These  features  will  be 
evaluated  when  the  single-channel  systems  are  evaluated  at  each  eche’on. 
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Concept  BRAVO  assets. 


FIGURE  G— 2 Division  Communications  Concepts 


3.0  APPLICABILITY  OF  THE  EFFECTIVENESS  METHODOLOGY 
TO  THE  EVALUATION  OF  SINGLE  CHANNEL 


The  effectiveness  methodology  presented  in  the  Task  III  report  is 
applicable  to  the  evaluation  of  single-channel  systems.  The  network  model 
SIMCE  sizes  single-channel  requirements,  and  measures  GOS  and  SOS  for 
single  channel. 

First,  the  model  provides  typical  unit  single-channel  needlines  by 
mode,  precedence,  frequency,  length,  and  purpose  (for  example,  TUN  6 to 
TUN  7,  voice,  6 routine  messages,  average  length  40  seconds,  administrative). 
Communications  analysts  will  identify  the  single- channel  nets  available  to 
each  unit,  and  will  specify  the  net  to  be  used  for  each  needline.  SIMCE 
randomly  generates  the  appropriate  number  of  messages  for  each  net  for  the 
time  period  to  be  simulated.  If  the  net  is  not  available  when  the  message 
is  to  be  sent,  it  enters  a queue  for  that  net.  At  the  end  of  the  simula- 
tion, statistics  are  provided  by  net  on  the  total  number  of  messages  that 
were  queued,  the  average  queueing  time,  and  the  number  of  messages  still 
in  queue.  The  first  statistic  relates  to  GOS  and  the  second  to  SOS. 

In  addition  to  SIMCE,  the  IPM  will  be  used  to  evaluate  single-channel 
systeam.  As  part  of  the  EMC/EMV  analysis,  this  model  will  measure: 

0 Message  intelligibility  without  interference; 

• Message  intelligibility  with  unintentional  interference; 

• Impact  of  Jamming; 

• Susceptibility  to  direction-finding; 

• Interceptibility; 

• RF  spectrum  requirements  and  flexibility  of  frequency 
assignments. 

Single  channel  will  also  be  evaluated  in  terms  of  all  other  MOEs. 
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4.0  TRADEOFF  ANALYSIS 


In  the  •£ fectivenese  evaluation,  weak  areas  will  be  identified  and 
Improved  if  possible.  Trsdeoffs  will  be  made  between  net  radio  require- 
ments currently  filled  by  ground  systems  and  those  that  can  be  satisfied 
by  other  means.  To  be  considered  are  traffic  load,  methods  of  modulation, 
antijaaaning  functions,  numbers  and  types  of  users  against  associated 
bandvidths,  and  associated  quantities  of  ground  terminals  required. 

The  results  of  the  evaluation  will  identify  the  advantages  and  dis- 
advantages of  each  system.  The  subsequent  cost  and  effectiveness  tradeoff 
analysis  will  enable  the  contractor  to  provide  the  Army  with  a recommended 
mix  of  single  channel  FM,  TACSAT,  MARTS,  etc.  The  rationale  behind  this 
recommendation  will  be  documented. 
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APPENDIX  H 

TABLE  OF  ABBREVIATIONS 


APPENDIX  H 

TABLE  OF  ABBREVIATIONS 


ALMC 

AMC 

AOE 

ARTADS 

AUTOVON 

BTU 

CASE 

CDT 

CE 

CEA 

CER 

COMSR 

CONAF 

CONUS 

COR 

CP 

DAI 

DA/ SAG 

DCS 

DoDI 

DS/GS 

DTE 

EAD 

ECM 

EMC/EMV 

ECP 

EMETF 


Army  Logistics  Management  Center 
(U.S.)  Army  Materiel  Command 
Area  of  effectiveness 
Army  Tactical  Data  Systems 
Automatic  voice  network 
British  thermal  unit 

Communications  Analysis  Simulation  Evaluation 
Contractor  development  tests 
Communications-electronics 
Communications-Electronics  Agency 
Cost-estimating  relationship 
Communications  support  requirement 
Conceptual  Army  of  the  Future 
Cortlnental  United  States 
Contracting  officer's  representative 
Command  post 

Discrete  address  identifier 

Department  of  the  Army,  Study  Advisory  Group 

Defense  Communications  System 

Department  of  Defense  instructions 

Direct  support/general  support 

Development  test  and  evaluation 

Echelons  above  Division 

Electronic  countermeasures 

Electromagnetic  compatibility/electrovnagnetic  vulnerability 
Engineering  change  procedure 
Electromagnetic  environmental  test  facility 
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7EBA 

FSD 

FOM 

04A 

GFE 

GFI 

GOS 

Hz 

ILS 

I NT ACS 

IOTE 

IPM 

kU 

LCC 

LOS 

LRTF 

MHz 

MOE 

MOS 

MRTF 

MTBF 

MTTR 

MHO 

N/A 

NORM 

NORS 

O&M 

OPA 

OR 

OTE 

PEP 

POL 

PM 


Forward  edge  of  beetle  area 
Full-scale  development 
Figure  of  merit 
General  and  administrative 
Government-furnished  equipment 
Government-furnished  Information 
Grade  of  service 
Hertz 

Integrated  logistical  support 

Integrated  Tactical  Communications  System 

Initial  operational  test  and  evaluation 

Interference  prediction  model 

Kilowatt 

Life-cycle  cost 

Llne-of-slght 

Long  range  time  frame 

MegaHertz 

Measure  of  effectiveness 
Military  occupational  specialty 
Mid  range  time  frame 
Mean  time  between  failure 
Mean  time  to  repair 
Modification  work  order 
Not  applicable 

Not  operationally  ready  (maintenance) 

Not  operationally  ready  (supply) 

Operation  and  maintenance 
Other  procurement /Army 
Operations  research 
Operational  test  and  evaluation 
Produdblllty,  engineering,  and  planning 
Petroleum,  oil,  and  lubricants 
Preventive  maintenance 


» 
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P(SO) 

Probability  of  satisfactory  operation 

R&D 

Research  and  development 

REU 

Range  extension  unit 

RF 

Radio  frequency 

RWI 

Radio-wire  integration 

SE 

System  effectiveness 

SIG  SEC 

Signal  security 

S1MCE 

Simulation  - Communications-Electronics 

SOS 

Speed  of  service 

SSB 

Single  sideband 

su 

Subscriber  unit 

TA 

Theater  Army 

TCCF 

Tactical  communications  control  facility 

TECCM 

(U.S.  Army)  Test  and  Evaluation  Command 

TM 

Technical  manual 

TP 

Telephone 

TOE 

Table  of  organization  and  equipment 

m 

Teletype 

UCR 

User  communication  requirement 

UGS 

Unattended  ground  sensor 

UTM 

Universal  Transverse  Mercator 

USAEPG 

U.S,  Army  Electronic  Proving  Ground 

USAMSSA 

U.S.  Army  Management  Systems  Support  Agency 

APPENDIX  I 
GLOSSARY  OF  ITEMS 


AaaMnhiase  - A collection  of  items  designed  to  accomplish  one  general 

.nd  Issued  ..  . single  Item.  Me,  consist 

of  item*  included  in  more  than  one  class  of  supply,  and  may 
include  items  for  which  logistical  responsibilities  are  assigned 

to  more  than  one  agency e 

Due,  hour  - The  continuous  cne-hour  period  that  has  the  maximum  average 
traffic  intensity. 

Call  - An  attempt  to  reach  a subscriber,  whether  successful  or  not;  in 
” other  words,  s valid  request  for  service. 

Common  user  network  - A system  of  circuit  or  channels  allocated  to  furnish 

conmtunicat ions  parts  between  switching  centers  to  provide  communi- 
cations service  on  a common  basis  to  all  connected  statior s or 

subscribers . 

Component  - A part  of  a whele;  for  example,  parts  of  an  assembly  or  any 

22  combination  of  parts,  subassemblies,  and  assemblies  mounted  together 
to  manufacture,  assemble,  maintain,  or  rebuild. 

CnHunicat ions  - A method  or  means  of  conveying  information  of  any  kind  ^ 
*rom  one  person  or  place  to  another,  except  by  direct,  unassisted 
conversation  or  correspondence  through  nonmilitary  postal  agencies. 

Comunicat ions  canter  - A facility  responsible  for  the  reception,  trans- 
mission,  and  delivery  of  messages.  Its  normal  elements  are  a 
message  center  section,  a cryptographic  section,  and  a sending 
and  receiving  section  using  electronic  communications  devices. 

~~ cffWy.n<f»«Mr>n«-alectronlcs  - Embraces  design,  development,  installation, 
operation,  and  maintenance  of  electronic  and  electromechanica 
systems  associated  with  collecting,  transmitting,  storing,  Pro- 
cessing, recording,  and  displaying  data  and  information  associated 
with  all  forms  of  military  communications  (exeluuing  the 
responsibility  for  information  and  data  systems  and  equipment 
which  has  been  otherwise  assigned). 
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^oaBunicab 11 1 t y - The  ability  of  communications-electronics  equipments, 

subsystems,  and  systems,  together  with  electromagnetic  devices,  to 
operate  in  their  intended  operational  environment  without  suffering 
degradation  because  of  natural  or  uncontrolled  manmade  noise. 

cations  security  - Protection  that  results  from  all  measures 
designed  to:  1)  deny  unauthorized  persons  information  of  value 
that  might  be  derived  from  the  possession  and  study  of  tele- 
communications, or  2)  mislead  unauthorized  persons  in  their 
interpretation  of  the  results  of  such  possession  and  study. 

Includes  cryptosecarity,  transmission  security,  emission  secu- 
rity, and  physical  security  of  communications  security  materials 
and  information. 

Compatibility  - The  ability  of  communications-electronics  equipments, 
subsystems,  and  systems,  together  with  electromagnetic  devices, 
to  operate  in  their  intended  operational  environments  without 
suffering  or  causing  unacceptable  degradation  because  of  uninten- 
tional, unwanted  electromagnetic  radiation  or  response. 

^ltlc«l  ^ - Th.  ..quCTc.  of  .vents  of  . mult  It.. k job  th.t  determines 
the  minimum  time  for  completion  of  a job.  These  events  may  be 
•^•11*bility  of  manpower  or  equipment.  Delays 
thl'j^b”*1  *l0X18  th€  Critical  path  upset  the  overall  timetable  of 

~Ptl°g  I J«llb«at«  radiation,  reradiation,  alteration,  absorption, 
i 0X1  °4f  eJ*cbroM8netic  energy  in  a manner  intended  to  mis- 
lead  an  enemy  in  the  interpretation  or  use  of  information  received 
by  his  electronic  systems. 

Directory  - An  assignment  of  alphanumeric  symbols  to  uniquely  identify 

•“**  8UiuCrib!r*  e<luiPnent»  or  process  in  a communications  net- 
work.  The  order  of  the  directory  symbols  may  be  arranged  to  permit 
subscribers  to  memorize  or  easily  deduce  the  symbols  of  othe/ 
subscribers* 

Direct  support  - Support  provided  by  a unit  or  formation  not  attached  to 
or  under  command  of  the  supported  unit  or  formation,  but  required 
to  give  priority  to  the  support  required  by  that  unit  or  formation. 

Direction-finding  - A procedure  for  obtaining  the  bearings  of  radio 

through  the  U8fi  of  hlihlY  directional  antennas 
end  a display  un^t  on  an  intercept  receiver  or  ancillary  equipment. 

Electromagnetic  compatibility  - Th.  ability  of  communications-electronic 
equipmenta,  subsystems,  and  systems,  together  with  electromagnetic 
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devices,  to  operate  in  their  intended  operational  environments 
without  suffering  or  causing  unacceptable  degradation  because 
of  unwanted  electromagnetic  radiation  or  response. 

grleng  - A unit  of  traffic  denuity  that  represents  full  occupation 

of  one  channel  end  is  equal  to  one  traffic  unit.  For  a group  of 
channels,  the  average  intensity  of  traffic  during  a period  T 
equals  the  total  occupancy  divided  by  T.  For  example,  five 
channels  occupied  AO  percent  of  the  time  carry,  on  the  average, 
two  erlangs  (120  call  minutes  per  hour  or  2 call  hours  per  hour). 

Facsimile  - A line-scanning  system  of  telecommunications  for  transmitting 
fixed  images,  with  or  without  halftones,  with  a view  of  their 
reproduction  in  a permanent  form  (wirephoto  end  telephoto  are 
facsimile  through  wire  circuit;  radiophoto  is  facsimile  via  radio). 

Interceptlbility  - The  ability  of  an  intercept  receiver  to  detect,  locate, 
identify,  and  analyze  electromagnetic  emissions  from  communications- 
clectronlcs  equipments,  subsystems,  and  systems,  together  with 
electromagnetic  devices,  in  their  intended  operational  environment 
without  suffering  unacceptable  degradation  because  of  unintentional, 
unwanted  electromagnetic  radiation. 

Interference  (intentional)  - Interference  caused  by  deliberately  over- 
riding a desired  signal  with  an  interfering  or  misleading  signal. 
This  is  an  aspect  of  electronic  warfare  or  jamming. 

Link  - Can  be:  1)  a portion  of  a communications  circuit;  2)  a channel  or 
circuit  designed  to  be  connected  in  tandem  with  other  channels  of 
circuits;  or  3)  a radio  path  between  two  points,  called  unidirec- 
tional, half-duplex.  (The  term  "link"  should  be  defined  or  quali- 
fied when  used.  It  is  generally  accepted  that  the  signals  at 
each  end  of  a link  are  in  the  same  form. ) 

Loop  - Communication  line  between  a unit  and  a node. 

Message  - Any  thought  or  idea  expressed  briefly  in  a plain  or  secret 
language,  prepared  in  a form  suitable  for  transmission  by  any 
means  of  communication. 

Meta age  center  - A communications  center  element  that  is  responsible  for 
accepting  and  processing  messages,  both  incoming  and  outgoing. 

Mode  (of  transmission)  - The  method  uaed  to  convey  intelligence  from  one 
force  unit  to  another  force  unit. 
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Module  - A packaged  functional  hardware  unit  designed  for  use  with  other 
components;  It  can  be  an  Item,  assembly!  or  component  that  Is 
deslgnad  to  be  handled  aa  a single  unit!  and  is  normally  packaged 
as  an  ldentlflabla  entity  for  supply  or  maintenance  purposes. 

Need  line  - The  requirement  of  one  force  unit  to  communicate  with  another 
force  unit. 

Net  - One  or  more  transmitters  and  receivers  operating  on  a single  fre- 
quency with  a connor  tactical  purpose  or  function.  May  contain 
as  few  as  one  transmitter  and  one  receiver  (as  In  the  case  of  a 
radio  relay  system  In  one  direction  of  communication) , or  as  many 
as  a dozen  or  more  transmitters  and  receivers  (as  In  the  case  of 
cornea nd  nets). 

Node  - A point  through  which  sure  than  one  circuit  passes!  where  a 

switching  function  can  be  performed  (but  need  not  take  place)  • and 
where  system  outlets  may  exist. 

Snapshot  - An  arbitrary,  short  Interval  in  time  In  which  a situation  can 
ba  observed,  analyzed,  and  evaluated. 

Subsystem  - A major  functional  division  within  a system;  a subsystem  per- 
forms one  or  more  specific  tasks. 

System  - An  Integrated  relationship  of  components  aligned  to  establish 
proper  functional  continuity  toward  the  successful  performance  of 
a daflned  task  or  tasks. 

Traffic  - The  aggregate  information  available  on  the  cormunlcatlons  con- 
tent, characteristics,  and  quantity  that  describes  a needline  (all 
transmitted  and  received  messages). 

User  communication  requirements  - A quantitative  statement  of  communica- 
tions at  the  user  level,  without  reference  to  specific  hardware  or 
comaunlcatlons  system  design.  Specification  of  the  UCR  Is  to 
Include  source-sink  relationships  plus  Identification  of  communi- 
cations Information  content,  characteristics,  and  quantity. 


Vulnerability  (electromagnetic)  - A measure  of  degradation  of  the  ability 
of  communications -electronics  equipment,  subsystems,  and  systems, 
together  with  electromagnetic  devices,  to  operate  in  their  Intended 
operational  environment  because  of  unwanted  response  to  Intentional 
electromagnetic  radiation  utilized  In  electronic  warfare. 


Vulnerability  (general)  - The  characteristics  that  cause  a system  to  suffer 
a definite  degradation  (Incapability  to  perform  the  designated  mis- 
sion) as  a result  of  having  been  subjected  to  a certain  level  of 
effects  In  unnatural  (man-made)  hostile  environment. 
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